Sep 19 01:10:19.907859 ip-10-0-143-9 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 19 01:10:19.907871 ip-10-0-143-9 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 19 01:10:19.907878 ip-10-0-143-9 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 19 01:10:19.908031 ip-10-0-143-9 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 19 01:10:30.135152 ip-10-0-143-9 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 19 01:10:30.135169 ip-10-0-143-9 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3aa559987e854050acc864a1cb7deeb8 --
Sep 19 01:12:31.228187 ip-10-0-143-9 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 01:12:34.729426 ip-10-0-143-9 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 01:12:34.729426 ip-10-0-143-9 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 01:12:34.729426 ip-10-0-143-9 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 01:12:34.729426 ip-10-0-143-9 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 01:12:34.729426 ip-10-0-143-9 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 01:12:34.730215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.729505    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 01:12:34.733377 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733362    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.733377 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733376    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.733377 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733380    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733384    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733387    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733390    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733394    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733398    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733400    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733404    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733407    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733410    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733413    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733415    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733418    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733428    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733430    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733433    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733436    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733439    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733442    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733444    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.733472 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733447    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733450    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733452    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733455    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733457    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733460    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733463    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733465    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733468    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733470    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733473    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733476    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733478    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733481    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733484    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733487    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733489    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733492    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733494    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733497    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.733963 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733499    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733502    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733504    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733507    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733509    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733512    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733514    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733517    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733519    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733522    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733524    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733527    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733529    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733532    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733535    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733538    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733540    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733543    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733545    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733548    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.734455 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733551    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733553    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733558    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733562    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733565    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733567    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733570    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733573    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733575    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733579    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733582    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733584    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733587    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733590    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733592    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733595    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733597    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733600    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733602    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.734949 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733605    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733608    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733610    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733612    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733617    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733621    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733625    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733629    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733632    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733634    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733637    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733639    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733642    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733645    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733647    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733651    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733654    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.733657    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734327    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.735415 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734333    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734336    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734341    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734344    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734348    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734351    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734354    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734357    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734360    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734363    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734365    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734368    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734371    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734373    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734376    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734380    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734383    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734386    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734389    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.735885 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734392    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734395    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734398    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734400    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734403    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734406    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734408    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734411    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734413    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734416    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734419    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734421    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734423    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734426    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734429    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734431    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734434    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734436    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734439    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734442    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.736373 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734445    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734448    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734452    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734455    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734458    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734461    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734463    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734466    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734469    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734472    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734475    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734478    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734482    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734484    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734487    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734489    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734492    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734495    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734498    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.736861 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734500    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734503    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734505    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734508    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734510    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734513    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734515    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734518    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734520    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734523    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734525    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734528    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734531    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734533    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734536    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734539    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734541    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734544    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734546    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734549    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.737351 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734551    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734554    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734557    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734559    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734563    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734567    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734570    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734572    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734575    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734577    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734580    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734583    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734585    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734588    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734591    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734593    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734595    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734598    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734600    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734603    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.737837 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734994    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.734999    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735001    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735004    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735010    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735013    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735015    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735018    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735020    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735023    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735026    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735028    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735031    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735033    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735036    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735040    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735043    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735046    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735048    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735051    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.738338 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735054    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735057    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735060    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735064    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735067    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735071    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735074    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735077    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735080    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735083    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735085    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735088    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735091    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735094    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735096    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735099    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735102    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735105    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735107    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.738854 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735110    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735113    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735115    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735118    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735121    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735124    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735128    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735131    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735135    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735138    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735141    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735144    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735147    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735150    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735158    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735163    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735167    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735170    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735173    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.739323 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735175    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735178    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735181    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735183    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735186    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735189    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735191    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735194    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735199    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735201    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735204    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735206    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735210    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735212    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735215    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735218    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735221    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735224    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735226    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735229    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.739794 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735231    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735234    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735236    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735239    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735241    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735244    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735247    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735249    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735252    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735254    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735257    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735260    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735262    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735265    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735267    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735270    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735272    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735275    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735278    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735280    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.735284    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.740364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735368    2567 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735407    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735413    2567 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735417    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735422    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735428    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735432    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735436    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735439    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735442    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735446    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735449    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735452    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735455    2567 flags.go:64] FLAG: --cgroup-root=""
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735458    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735461    2567 flags.go:64] FLAG: --client-ca-file=""
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735464    2567 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735467    2567 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735472    2567 flags.go:64] FLAG: --cluster-domain=""
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735475    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735478    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735481    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735484    2567 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735488    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 01:12:34.740874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735491    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735494    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735498    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735501    2567 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735504    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735507    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735510    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735514    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735518    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735521    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735524    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735526    2567 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735530    2567 flags.go:64] FLAG: --enable-server="true"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735534    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735538    2567 flags.go:64] FLAG: --event-burst="100"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735541    2567 flags.go:64] FLAG: --event-qps="50"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735544    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735548    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735551    2567 flags.go:64] FLAG: --eviction-hard=""
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735554    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735557    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735560    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735563    2567 flags.go:64] FLAG: --eviction-soft=""
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735565    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735568    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 01:12:34.741468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735571    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735574    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735577    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735580    2567 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735582    2567 flags.go:64] FLAG: --feature-gates=""
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735586    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735589    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735592    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735595    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735599    2567 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735602    2567 flags.go:64] FLAG: --help="false"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735604    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-9.ec2.internal"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735607    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735610    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735614    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735618    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735621    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735624    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735627    2567 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735629    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735633    2567 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735637    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735640    2567 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735643    2567 flags.go:64] FLAG: --kube-reserved=""
Sep 19 01:12:34.742111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735645    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735648    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735651    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735654    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735657    2567 flags.go:64] FLAG: --lock-file=""
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735660    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735662    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735665    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735670    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735673    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735676    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735678    2567 flags.go:64] FLAG: --logging-format="text"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735681    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735685    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735687    2567 flags.go:64] FLAG: --manifest-url=""
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735690    2567 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735694    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735697    2567 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735701    2567 flags.go:64] FLAG: --max-pods="110"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735704    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735707    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735710    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735715    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735718    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735721    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 01:12:34.742699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735723    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735730    2567 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735733    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735737    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735740    2567 flags.go:64] FLAG: --pod-cidr=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735743    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735749    2567 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735752    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735755    2567 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735758    2567 flags.go:64] FLAG: --port="10250"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735761    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735764    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0207b20b0389ce3ee"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735767    2567 flags.go:64] FLAG: --qos-reserved=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735770    2567 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735772    2567 flags.go:64] FLAG: --register-node="true"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735775    2567 flags.go:64] FLAG: --register-with-taints=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735779    2567 flags.go:64] FLAG: --registry-burst="10"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735782    2567 flags.go:64] FLAG: --registry-qps="5"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735784    2567 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735787    2567 flags.go:64] FLAG: --reserved-memory=""
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735795    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735798    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735801    2567 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735804    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735807    2567 flags.go:64] FLAG: --runonce="false"
Sep 19 01:12:34.743378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735810    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735813    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735816    2567 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735819    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735821    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735826    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735829    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735832    2567 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735835    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735838    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735842    2567 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735845    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735848    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735851    2567 flags.go:64] FLAG: --system-cgroups=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735854    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735859    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735862    2567 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735865    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735870    2567 flags.go:64] FLAG: --tls-min-version=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735873    2567 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735875    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735878    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735881    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735885    2567 flags.go:64] FLAG: --v="2"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735888    2567 flags.go:64] FLAG: --version="false"
Sep 19 01:12:34.744474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735892    2567 flags.go:64] FLAG: --vmodule=""
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735896    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.735900    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736018    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736022    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736025    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736028    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736031    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736034    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736037    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736040    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736042    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736046    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736048    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736051    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736054    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736056    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736059    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736062    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.745467 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736065    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736067    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736071    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736073    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736076    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736079    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736081    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736084    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736087    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736089    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736092    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736094    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736097    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736100    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736102    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736105    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736107    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736110    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736112    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736122    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.745966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736125    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736127    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736130    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736133    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736135    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736138    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736141    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736144    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736146    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736149    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736152    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736154    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736157    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736160    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736162    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736166    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736168    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736171    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736174    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736176    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.746462 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736179    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736182    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736184    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736187    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736189    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736192    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736195    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736199    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736202    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736205    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736209    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736213    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736217    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736219    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736222    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736225    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736228    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736230    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736234    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.746965 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736238    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736241    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736244    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736247    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736250    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736253    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736255    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736258    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736261    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736264    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736267    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736269    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736272    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736275    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736277    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736280    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736282    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736285    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736288    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736290    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736293    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.747442 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736295    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736298    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.736301    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.736987    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.745836    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.745850    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.745869    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.745878    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745949    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745955    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745959    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745962    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745965    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745968    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.747999 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745971    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745975    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745978    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745981    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745984    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745987    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745989    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745992    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745995    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.745998    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746002    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746006    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746009    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746013    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746016    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746019    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746021    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746030    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746032    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.748353 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746035    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746038    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746041    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746043    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746047    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746050    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746053    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746055    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746058    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746061    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746063    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746066    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746069    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746072    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746074    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746077    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746080    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746082    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746085    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746088    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.748818 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746091    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746094    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746096    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746099    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746102    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746105    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746108    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746110    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746113    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746115    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746118    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746120    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746123    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746125    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746128    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746130    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746134    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746137    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746141    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.749305 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746145    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746148    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746151    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746153    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746156    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746158    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746161    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746163    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746166    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746168    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746171    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746174    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746176    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746179    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746183    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746187    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746190    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746192    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746195    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746197    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.749795 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746200    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746203    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746205    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746208    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746210    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746213    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746215    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746218    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746221    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746223    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746226    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746229    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746231    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746234    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746237    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.750302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.746242    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746355    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746360    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746363    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746367    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746371    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746374    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746376    2567 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746379    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746382    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746385    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746387    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746390    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746393    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746396    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746398    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746401    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746404    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746406    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746409    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 01:12:34.750699 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746412    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746414    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746417    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746419    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746422    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746424    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746427    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746430    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746433    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746435    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746438    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746440    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746444    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746447    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746451    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746454    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746457    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746459    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746462    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 01:12:34.751202 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746464    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746467    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746470    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746473    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746475    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746478    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746481    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746484    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746487    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746490    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746492    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746495    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746497    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746500    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746503    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746505    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746508    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746511    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746513    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746516    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 01:12:34.751651 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746519    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746521    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746524    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746526    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746529    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746532    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746534    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746537    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746544    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746546    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746549    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746552    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746554    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746557    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746559    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746562    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746564    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746567    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746570    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746572    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 01:12:34.752255 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746575    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746579    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746581    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746584    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746586    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746589    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746591    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746594    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746596    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746599    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746601    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746605    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746607    2567 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746610    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746612    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746615    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746618    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746621    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746624    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 01:12:34.752744 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746627    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:34.746630    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.746635    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.746735    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.749432    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.750407    2567 server.go:1019] "Starting client certificate rotation"
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.750510    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 01:12:34.753218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.750541    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 01:12:34.753782 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.753769    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 01:12:34.755499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.755482    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 01:12:34.763710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.763695    2567 log.go:25] "Validated CRI v1 runtime API"
Sep 19 01:12:34.765420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.765402    2567 log.go:25] "Validated CRI v1 image API"
Sep 19 01:12:34.767163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.767140    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 01:12:34.769440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.769420    2567 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8c391416-02eb-4ced-b380-87b16fef8ded:/dev/nvme0n1p4 e6d8eba2-369a-46fe-bc7f-705a62ec504b:/dev/nvme0n1p3]
Sep 19 01:12:34.769513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.769437    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 01:12:34.774541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.774427    2567 manager.go:216] Machine: {Timestamp:2026-09-19 01:12:34.773022725 +0000 UTC m=+2.114470639 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103268 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec297c8be789d522cd623d902959794a SystemUUID:ec297c8b-e789-d522-cd62-3d902959794a BootID:3aa55998-7e85-4050-acc8-64a1cb7deeb8 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f5:1a:c4:c7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f5:1a:c4:c7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:70:10:c4:e7:3b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 01:12:34.774541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.774533    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 01:12:34.774685 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.774602    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 01:12:34.777094 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.777072    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 01:12:34.777226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.777095    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-9.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 01:12:34.779338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.779326    2567 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 01:12:34.779385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.779341    2567 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 01:12:34.779385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.779349    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 01:12:34.779385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.779363    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 01:12:34.781456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.781445    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 01:12:34.782547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.782532    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 01:12:34.784647 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784636    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 01:12:34.784749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784740    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 01:12:34.784788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784777    2567 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 01:12:34.784815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784789    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 01:12:34.784815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784802    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 01:12:34.784815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784810    2567 kubelet.go:398] "Adding apiserver pod source"
Sep 19 01:12:34.784900 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.784841    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 01:12:34.788266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.788242    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 01:12:34.788344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.788276    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 01:12:34.791835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.791818    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 01:12:34.794060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.794046    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 01:12:34.794128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.794076    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 01:12:34.795105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795094    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795110    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795116    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795121    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795130    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795135    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795148    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 01:12:34.795161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795160    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795168    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795173    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795181    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795186    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795209    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 01:12:34.795357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.795214    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 01:12:34.797861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.797845    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-9.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 01:12:34.798752 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.798740    2567 server.go:1268] "Started kubelet"
Sep 19 01:12:34.798861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.798820    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 01:12:34.798931 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.798878    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 01:12:34.799129 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.799108    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 01:12:34.799194 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.799108    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 01:12:34.799194 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.799162    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 01:12:34.799724 ip-10-0-143-9 systemd[1]: Started Kubernetes Kubelet.
Sep 19 01:12:34.800153 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.799991    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 01:12:34.800409 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.800396    2567 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 01:12:34.806791 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.806774    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 01:12:34.806877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.806790    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 01:12:34.807010 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.806977    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:34.807847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.807831    2567 factory.go:55] Registering systemd factory
Sep 19 01:12:34.807847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.807848    2567 factory.go:223] Registration of the systemd container factory successfully
Sep 19 01:12:34.808013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.807958    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 01:12:34.808074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808019    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 01:12:34.808074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808032    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 01:12:34.808074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808038    2567 factory.go:153] Registering CRI-O factory
Sep 19 01:12:34.808074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808050    2567 factory.go:223] Registration of the crio container factory successfully
Sep 19 01:12:34.808244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808096    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 01:12:34.808244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808116    2567 factory.go:103] Registering Raw factory
Sep 19 01:12:34.808244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808132    2567 manager.go:1196] Started watching for new ooms in manager
Sep 19 01:12:34.808244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808149    2567 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 01:12:34.808244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808157    2567 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 01:12:34.808796 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.808777    2567 manager.go:349] Starting recovery of all containers
Sep 19 01:12:34.809961 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.809931    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 01:12:34.817444 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.817423    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 01:12:34.817558 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.817539    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-9.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 01:12:34.819629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.819528    2567 manager.go:354] Recovery completed
Sep 19 01:12:34.829465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.829438    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5vx4"
Sep 19 01:12:34.830743 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.830690    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 19 01:12:34.834610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.834595    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:34.835426 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.834245    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-9.ec2.internal.18d693c001c002ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-9.ec2.internal,UID:ip-10-0-143-9.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-9.ec2.internal,},FirstTimestamp:2026-09-19 01:12:34.798715594 +0000 UTC m=+2.140163508,LastTimestamp:2026-09-19 01:12:34.798715594 +0000 UTC m=+2.140163508,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-9.ec2.internal,}"
Sep 19 01:12:34.836078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836061    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l5vx4"
Sep 19 01:12:34.836187 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836173    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:34.836228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836201    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:34.836228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836213    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:34.836701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836686    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 01:12:34.836701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836699    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 01:12:34.836826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836699    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:34.836826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.836717    2567 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 01:12:34.837403 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.837383    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:34.837468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.837422    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:34.837468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.837438    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:34.838416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.838400    2567 policy_none.go:49] "None policy: Start"
Sep 19 01:12:34.838416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.838417    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 01:12:34.838532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.838426    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 01:12:34.839828 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.839817    2567 policy_none.go:47] "Start"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875434    2567 manager.go:337] "Starting Device Plugin manager"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.875462    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875471    2567 server.go:87] "Starting device plugin registration server"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875628    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875650    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875741    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875811    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.875817    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.876250    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 01:12:34.883682 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.876302    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:34.913130 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.913109    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 01:12:34.914184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.914168    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 01:12:34.914251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.914212    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 01:12:34.914251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.914239    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 01:12:34.914351 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.914273    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 01:12:34.916597 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.916576    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 01:12:34.976576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.976562    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:34.977316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.977299    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:34.977415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.977327    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:34.977415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.977340    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:34.977415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.977365    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-9.ec2.internal"
Sep 19 01:12:34.987064 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:34.987031    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-9.ec2.internal"
Sep 19 01:12:34.987064 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:34.987048    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-9.ec2.internal\": node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.014326 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.014304    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.014411 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.014358    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"]
Sep 19 01:12:35.014450 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.014418    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:35.015101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.015084    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:35.015178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.015111    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:35.015178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.015125    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:35.016241 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016229    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:35.016381 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.016428 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016392    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:35.016873 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016860    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:35.016963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016880    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:35.016963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016893    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:35.016963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016935    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:35.016963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016958    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:35.017163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.016971    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:35.018098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.018085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.018141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.018107    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 01:12:35.018694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.018680    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 01:12:35.018766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.018707    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 01:12:35.018766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.018722    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeHasSufficientPID"
Sep 19 01:12:35.044485 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.044470    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-9.ec2.internal\" not found" node="ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.048677 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.048664    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-9.ec2.internal\" not found" node="ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.110762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.110743    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f301cdf4e0c29dc70eeb444d9a4d1da3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-9.ec2.internal\" (UID: \"f301cdf4e0c29dc70eeb444d9a4d1da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.110867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.110773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.110867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.110798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.114825 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.114803    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.211470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.211519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.211519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f301cdf4e0c29dc70eeb444d9a4d1da3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-9.ec2.internal\" (UID: \"f301cdf4e0c29dc70eeb444d9a4d1da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.211614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211531    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f301cdf4e0c29dc70eeb444d9a4d1da3-config\") pod \"kube-apiserver-proxy-ip-10-0-143-9.ec2.internal\" (UID: \"f301cdf4e0c29dc70eeb444d9a4d1da3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.211614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.211614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.211578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/814f2712dfe69728a741fedc9dfa521c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal\" (UID: \"814f2712dfe69728a741fedc9dfa521c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.215585 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.215569    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.316347 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.316299    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.347474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.347446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.352491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.352475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:35.417300 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.417272    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.517832 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.517808    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.618310 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.618252    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.718911 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.718888    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.750054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.750027    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 01:12:35.750473 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.750163    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 01:12:35.819961 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.819940    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.840547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.840520    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 01:07:34 +0000 UTC" deadline="2028-04-29 21:34:00.869033942 +0000 UTC"
Sep 19 01:12:35.840547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.840545    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14132h21m25.028491996s"
Sep 19 01:12:35.920133 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:35.920111    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-9.ec2.internal\" not found"
Sep 19 01:12:35.926665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.926647    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 01:12:35.946032 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:35.946003    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 01:12:36.007862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.007842    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:36.009945 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:36.009908    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf301cdf4e0c29dc70eeb444d9a4d1da3.slice/crio-21bab05de953c6a9f314a5f190b54bb9fde0e638f71699cf6ad6cace3c3279f9 WatchSource:0}: Error finding container 21bab05de953c6a9f314a5f190b54bb9fde0e638f71699cf6ad6cace3c3279f9: Status 404 returned error can't find the container with id 21bab05de953c6a9f314a5f190b54bb9fde0e638f71699cf6ad6cace3c3279f9
Sep 19 01:12:36.010500 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:36.010480    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814f2712dfe69728a741fedc9dfa521c.slice/crio-0817233e77169d2ad1af53b1b61b3ba6513786b51f3b857d410206f65c196b7f WatchSource:0}: Error finding container 0817233e77169d2ad1af53b1b61b3ba6513786b51f3b857d410206f65c196b7f: Status 404 returned error can't find the container with id 0817233e77169d2ad1af53b1b61b3ba6513786b51f3b857d410206f65c196b7f
Sep 19 01:12:36.015360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.015348    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 01:12:36.019580 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.019564    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 01:12:36.021310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.021292    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal"
Sep 19 01:12:36.031257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.031242    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 01:12:36.283612 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.283535    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 01:12:36.785433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.785412    2567 apiserver.go:52] "Watching apiserver"
Sep 19 01:12:36.792715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.792692    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 01:12:36.793201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.793178    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-849st","openshift-multus/network-metrics-daemon-dbmjk","openshift-network-diagnostics/network-check-target-f7mpf","openshift-network-operator/iptables-alerter-p6288","kube-system/global-pull-secret-syncer-p58b7","kube-system/konnectivity-agent-6rcls","kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal","openshift-cluster-node-tuning-operator/tuned-v9pcc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal","openshift-multus/multus-khzzp","openshift-ovn-kubernetes/ovnkube-node-zmst2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9","openshift-dns/node-resolver-4rrbn","openshift-image-registry/node-ca-2q64x"]
Sep 19 01:12:36.795263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.795244    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.797430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.797415    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.798838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.798410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gsx45\""
Sep 19 01:12:36.798838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.798652    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.799459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.799170    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.799459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.799257    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 01:12:36.799459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.799409    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.800016 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.799998    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.800240 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.800225    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-smspl\""
Sep 19 01:12:36.800780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.800537    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 01:12:36.800866 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.800786    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 01:12:36.800942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.800880    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.801329 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.801042    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:36.801329 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.801111    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:36.802249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.801746    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 01:12:36.802249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.801770    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 01:12:36.802249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802087    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.802249 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.802140    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:36.802518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802389    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lwkns\""
Sep 19 01:12:36.802704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802563    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 01:12:36.802704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802563    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.802704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802603    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.802889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.802740    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 01:12:36.803729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.803711    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.805128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.805112    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.806527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.806509    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 01:12:36.806719 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.806685    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f5z2m\""
Sep 19 01:12:36.806800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.806757    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 01:12:36.806905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.806886    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.808101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.807906    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.808101 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.807996    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:36.808101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.808093    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7l5hk\""
Sep 19 01:12:36.808344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.808307    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.809233 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.808466    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 01:12:36.809233 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.808497    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.809983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.809787    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 01:12:36.810073 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.809999    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.810621 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.810603    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9pxzt\""
Sep 19 01:12:36.810800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.810784    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 01:12:36.814314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.814185    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:36.814487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.814463    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.814632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.814617    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 01:12:36.814739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.814723    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.815992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.815583    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vxt45\""
Sep 19 01:12:36.817075 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.817055    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:36.817956 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.817939    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.818478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.818456    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.818605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.818480    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-l27rc\""
Sep 19 01:12:36.819741 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.819721    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 01:12:36.819953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.819934    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820125    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820269    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5zjgs\""
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820327    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-var-lib-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-multus-daemon-config\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820381    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c48076c9-eb3e-4732-8270-ee9708243caf-konnectivity-ca\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-socket-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-systemd-units\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovn-node-metrics-cert\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820494    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-cnibin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820516    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-sys\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820566    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-etc-kubernetes\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysconfig\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-tmp\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-kubelet\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.821291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-ovn\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-netd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820758    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-k8s-cni-cncf-io\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-run\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820801    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-var-lib-kubelet\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-etc-selinux\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820867    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-cni-binary-copy\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820898    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-hostroot\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.820974    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c48076c9-eb3e-4732-8270-ee9708243caf-agent-certs\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821002    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-lib-modules\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-log-socket\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821043    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkjz\" (UniqueName: \"kubernetes.io/projected/5911355c-4a74-44c6-a895-24e17ee6e7b5-kube-api-access-bgkjz\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-kubelet-config\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-config\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-script-lib\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821154    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821176    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47de3ad7-4204-475c-ab73-3717af51f00a-iptables-alerter-script\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821213    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821270    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94485\" (UniqueName: \"kubernetes.io/projected/65420911-0e63-4656-9460-51311cf8e4fb-kube-api-access-94485\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821301    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821321    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-registration-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-sys-fs\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-kubelet\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821361    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-node-log\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-bin\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-socket-dir-parent\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-netns\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-multus\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821499    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d68gt\" (UniqueName: \"kubernetes.io/projected/8c361331-b5c0-4bb1-921d-0ae317043067-kube-api-access-d68gt\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.822889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-host\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-device-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-etc-tuned\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-kubernetes\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821659    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-systemd\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-slash\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821721    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-netns\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821751    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-system-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-dbus\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821880    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47de3ad7-4204-475c-ab73-3717af51f00a-host-slash\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-cnibin\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821929    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-env-overrides\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-bin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.823649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-conf-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.821996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822011    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjbm7\" (UniqueName: \"kubernetes.io/projected/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kube-api-access-vjbm7\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822035    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-systemd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822059    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-multus-certs\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-system-cni-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822116    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f65g5\" (UniqueName: \"kubernetes.io/projected/7cdb9229-feb5-449c-837d-7d3917c98aef-kube-api-access-f65g5\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-etc-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822185    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-modprobe-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-conf\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmvfs\" (UniqueName: \"kubernetes.io/projected/20195353-0cae-4439-86ae-9be858e3b5d1-kube-api-access-wmvfs\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.824394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.822330    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmjnm\" (UniqueName: \"kubernetes.io/projected/47de3ad7-4204-475c-ab73-3717af51f00a-kube-api-access-lmjnm\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.828152 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.827943    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 01:12:36.861463 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.861442    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktvgg"
Sep 19 01:12:36.870492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.870440    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ktvgg"
Sep 19 01:12:36.908771 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.908745    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 01:12:36.919078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.919039    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal" event={"ID":"f301cdf4e0c29dc70eeb444d9a4d1da3","Type":"ContainerStarted","Data":"21bab05de953c6a9f314a5f190b54bb9fde0e638f71699cf6ad6cace3c3279f9"}
Sep 19 01:12:36.920275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.920253    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal" event={"ID":"814f2712dfe69728a741fedc9dfa521c","Type":"ContainerStarted","Data":"0817233e77169d2ad1af53b1b61b3ba6513786b51f3b857d410206f65c196b7f"}
Sep 19 01:12:36.923905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.923875    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:36.924012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.923930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-socket-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.924012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.923955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-systemd-units\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.923978    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovn-node-metrics-cert\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-cnibin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-sys\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-tmp-dir\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-etc-kubernetes\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysconfig\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-tmp\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e98f12d3-21a6-4761-9bd4-31fe87a862e8-serviceca\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-kubelet\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-ovn\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924270    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-netd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-k8s-cni-cncf-io\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924325    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-sys\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-netd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924404    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-cnibin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924435    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-etc-kubernetes\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924447    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-k8s-cni-cncf-io\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-socket-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysconfig\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-run\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-kubelet\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-var-lib-kubelet\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924585    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.924649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924620    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-ovn\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924661    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-systemd-units\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924659    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-etc-selinux\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924669    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-run\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924704    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-cni-binary-copy\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-hostroot\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c48076c9-eb3e-4732-8270-ee9708243caf-agent-certs\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-lib-modules\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924795    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-hosts-file\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924833    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-log-socket\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924839    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkjz\" (UniqueName: \"kubernetes.io/projected/5911355c-4a74-44c6-a895-24e17ee6e7b5-kube-api-access-bgkjz\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-var-lib-kubelet\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-kubelet-config\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.924985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-log-socket\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925007    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-hostroot\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-etc-selinux\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.925420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-lib-modules\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-config\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-kubelet-config\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925247    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-script-lib\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47de3ad7-4204-475c-ab73-3717af51f00a-iptables-alerter-script\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925324    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925349    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94485\" (UniqueName: \"kubernetes.io/projected/65420911-0e63-4656-9460-51311cf8e4fb-kube-api-access-94485\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925397    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-registration-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-sys-fs\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-kubelet\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-node-log\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-bin\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-cni-binary-copy\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925542    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-socket-dir-parent\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.926227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.925580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-netns\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.927020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.926315    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-script-lib\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.928538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928510    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-multus\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.928645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928567    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d68gt\" (UniqueName: \"kubernetes.io/projected/8c361331-b5c0-4bb1-921d-0ae317043067-kube-api-access-d68gt\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.928645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.928645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-host\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.928805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928670    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-device-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.928805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-etc-tuned\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.928805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928730    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clbdj\" (UniqueName: \"kubernetes.io/projected/e98f12d3-21a6-4761-9bd4-31fe87a862e8-kube-api-access-clbdj\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:36.928805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-kubernetes\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.928805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928795    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-systemd\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdzsf\" (UniqueName: \"kubernetes.io/projected/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-kube-api-access-cdzsf\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928855    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928866    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928900    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-slash\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928951    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-netns\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.928987    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-system-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929071    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovnkube-config\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929090    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-dbus\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929122    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-registration-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47de3ad7-4204-475c-ab73-3717af51f00a-host-slash\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-cnibin\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-env-overrides\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-bin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-conf-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjbm7\" (UniqueName: \"kubernetes.io/projected/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kube-api-access-vjbm7\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-systemd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.929429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929432    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-multus-certs\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-system-cni-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.929473    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929496    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f65g5\" (UniqueName: \"kubernetes.io/projected/7cdb9229-feb5-449c-837d-7d3917c98aef-kube-api-access-f65g5\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.929558    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:37.429523853 +0000 UTC m=+4.770971774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929594    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-etc-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-modprobe-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-conf\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmvfs\" (UniqueName: \"kubernetes.io/projected/20195353-0cae-4439-86ae-9be858e3b5d1-kube-api-access-wmvfs\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929715    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmjnm\" (UniqueName: \"kubernetes.io/projected/47de3ad7-4204-475c-ab73-3717af51f00a-kube-api-access-lmjnm\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e98f12d3-21a6-4761-9bd4-31fe87a862e8-host\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929775    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-cnibin\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929778    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-var-lib-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-var-lib-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-multus-daemon-config\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.930058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c48076c9-eb3e-4732-8270-ee9708243caf-konnectivity-ca\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.930718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.929168    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47de3ad7-4204-475c-ab73-3717af51f00a-host-slash\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.930718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-kubernetes\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930598    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-systemd\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5911355c-4a74-44c6-a895-24e17ee6e7b5-env-overrides\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-device-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-bin\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930745    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-run-netns\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930792    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930849    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-host\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-system-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.930978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.930886    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931039    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0c9a1446-5387-4dcc-8ffd-61865b20b704-dbus\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c48076c9-eb3e-4732-8270-ee9708243caf-konnectivity-ca\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-run-systemd\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-multus-certs\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7cdb9229-feb5-449c-837d-7d3917c98aef-system-cni-dir\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.931314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931286    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-etc-openvswitch\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.931576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931375    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-modprobe-d\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.931576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931472    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/20195353-0cae-4439-86ae-9be858e3b5d1-etc-sysctl-conf\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.931576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-cni-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.931715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931704    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.931891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-slash\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932134    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/47de3ad7-4204-475c-ab73-3717af51f00a-iptables-alerter-script\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932173    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c361331-b5c0-4bb1-921d-0ae317043067-multus-daemon-config\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-etc-tuned\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.932261    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.932337    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:12:37.432319553 +0000 UTC m=+4.773767468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932387    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-conf-dir\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932444    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-node-log\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-sys-fs\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932507    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7cdb9229-feb5-449c-837d-7d3917c98aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932529    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-kubelet\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932596    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kubelet-dir\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932807    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-multus-socket-dir-parent\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5911355c-4a74-44c6-a895-24e17ee6e7b5-host-cni-bin\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-run-netns\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.932985    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c361331-b5c0-4bb1-921d-0ae317043067-host-var-lib-cni-multus\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.933895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c48076c9-eb3e-4732-8270-ee9708243caf-agent-certs\") pod \"konnectivity-agent-6rcls\" (UID: \"c48076c9-eb3e-4732-8270-ee9708243caf\") " pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:36.935554 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.934236    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:36.936366 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.934257    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:36.936366 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.934271    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:36.936366 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:36.934347    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:37.434330432 +0000 UTC m=+4.775778347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:36.936366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.935760    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/20195353-0cae-4439-86ae-9be858e3b5d1-tmp\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.936366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.936301    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5911355c-4a74-44c6-a895-24e17ee6e7b5-ovn-node-metrics-cert\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.938567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.938541    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkjz\" (UniqueName: \"kubernetes.io/projected/5911355c-4a74-44c6-a895-24e17ee6e7b5-kube-api-access-bgkjz\") pod \"ovnkube-node-zmst2\" (UID: \"5911355c-4a74-44c6-a895-24e17ee6e7b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:36.942886 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.942859    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f65g5\" (UniqueName: \"kubernetes.io/projected/7cdb9229-feb5-449c-837d-7d3917c98aef-kube-api-access-f65g5\") pod \"multus-additional-cni-plugins-849st\" (UID: \"7cdb9229-feb5-449c-837d-7d3917c98aef\") " pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:36.943020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.942862    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d68gt\" (UniqueName: \"kubernetes.io/projected/8c361331-b5c0-4bb1-921d-0ae317043067-kube-api-access-d68gt\") pod \"multus-khzzp\" (UID: \"8c361331-b5c0-4bb1-921d-0ae317043067\") " pod="openshift-multus/multus-khzzp"
Sep 19 01:12:36.943874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.943636    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94485\" (UniqueName: \"kubernetes.io/projected/65420911-0e63-4656-9460-51311cf8e4fb-kube-api-access-94485\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:36.943874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.943827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmjnm\" (UniqueName: \"kubernetes.io/projected/47de3ad7-4204-475c-ab73-3717af51f00a-kube-api-access-lmjnm\") pod \"iptables-alerter-p6288\" (UID: \"47de3ad7-4204-475c-ab73-3717af51f00a\") " pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:36.944588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.944504    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmvfs\" (UniqueName: \"kubernetes.io/projected/20195353-0cae-4439-86ae-9be858e3b5d1-kube-api-access-wmvfs\") pod \"tuned-v9pcc\" (UID: \"20195353-0cae-4439-86ae-9be858e3b5d1\") " pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:36.945442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.945400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjbm7\" (UniqueName: \"kubernetes.io/projected/43455aa2-fd0e-4ae0-8858-e4a2675ce085-kube-api-access-vjbm7\") pod \"aws-ebs-csi-driver-node-967j9\" (UID: \"43455aa2-fd0e-4ae0-8858-e4a2675ce085\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:36.996596 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:36.996579    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 01:12:37.030405 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-hosts-file\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.030542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clbdj\" (UniqueName: \"kubernetes.io/projected/e98f12d3-21a6-4761-9bd4-31fe87a862e8-kube-api-access-clbdj\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.030542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdzsf\" (UniqueName: \"kubernetes.io/projected/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-kube-api-access-cdzsf\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.030542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030492    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e98f12d3-21a6-4761-9bd4-31fe87a862e8-host\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.030542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-tmp-dir\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.030765 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030546    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-hosts-file\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.030765 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e98f12d3-21a6-4761-9bd4-31fe87a862e8-serviceca\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.030765 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030578    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e98f12d3-21a6-4761-9bd4-31fe87a862e8-host\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.030954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030817    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-tmp-dir\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.030954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.030854    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e98f12d3-21a6-4761-9bd4-31fe87a862e8-serviceca\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.044727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.044683    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdzsf\" (UniqueName: \"kubernetes.io/projected/b867204f-1ec7-4775-b034-0e1e9cb5d7cd-kube-api-access-cdzsf\") pod \"node-resolver-4rrbn\" (UID: \"b867204f-1ec7-4775-b034-0e1e9cb5d7cd\") " pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.049756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.049736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clbdj\" (UniqueName: \"kubernetes.io/projected/e98f12d3-21a6-4761-9bd4-31fe87a862e8-kube-api-access-clbdj\") pod \"node-ca-2q64x\" (UID: \"e98f12d3-21a6-4761-9bd4-31fe87a862e8\") " pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.110870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.110840    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6288"
Sep 19 01:12:37.120507 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.120485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:12:37.129346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.129331    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-khzzp"
Sep 19 01:12:37.136102 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.136085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:37.143095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.143075    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9pcc"
Sep 19 01:12:37.149740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.149717    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-849st"
Sep 19 01:12:37.157399 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.157381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9"
Sep 19 01:12:37.171205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.171186    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4rrbn"
Sep 19 01:12:37.176659 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.176639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2q64x"
Sep 19 01:12:37.432570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.432490    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:37.432570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.432527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:37.432769 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.432648    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:37.432769 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.432662    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:37.432769 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.432712    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:12:38.432691672 +0000 UTC m=+5.774139593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:37.432769 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.432730    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:38.432720956 +0000 UTC m=+5.774168862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:37.533764 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.533731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:37.533964 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.533869    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:37.533964 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.533893    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:37.533964 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.533905    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:37.534131 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:37.533983    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:38.53396424 +0000 UTC m=+5.875412155 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:37.872605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.872527    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:07:36 +0000 UTC" deadline="2028-06-23 19:48:28.821439616 +0000 UTC"
Sep 19 01:12:37.872605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:37.872566    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15450h35m50.948878886s"
Sep 19 01:12:37.963310 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:37.963278    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47de3ad7_4204_475c_ab73_3717af51f00a.slice/crio-08937293d7691574f63a63eae27ca87a445ca9c2ad81f259658dce325747f128 WatchSource:0}: Error finding container 08937293d7691574f63a63eae27ca87a445ca9c2ad81f259658dce325747f128: Status 404 returned error can't find the container with id 08937293d7691574f63a63eae27ca87a445ca9c2ad81f259658dce325747f128
Sep 19 01:12:37.964846 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:37.964809    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb867204f_1ec7_4775_b034_0e1e9cb5d7cd.slice/crio-dd2c560482ce04299db12b508bfcf2c0bcf74badf05ce4eb216e65b95a665950 WatchSource:0}: Error finding container dd2c560482ce04299db12b508bfcf2c0bcf74badf05ce4eb216e65b95a665950: Status 404 returned error can't find the container with id dd2c560482ce04299db12b508bfcf2c0bcf74badf05ce4eb216e65b95a665950
Sep 19 01:12:37.969314 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:37.968231    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20195353_0cae_4439_86ae_9be858e3b5d1.slice/crio-0f8619230b540714ed6fbffa988a80d8896adb9ccdba231125d86f57ec3bef38 WatchSource:0}: Error finding container 0f8619230b540714ed6fbffa988a80d8896adb9ccdba231125d86f57ec3bef38: Status 404 returned error can't find the container with id 0f8619230b540714ed6fbffa988a80d8896adb9ccdba231125d86f57ec3bef38
Sep 19 01:12:37.971951 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:12:37.971076    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43455aa2_fd0e_4ae0_8858_e4a2675ce085.slice/crio-5b89ae6546a87a5241ea1e6b53b9cdcf772957131318e0f9432f73ec65b00ce3 WatchSource:0}: Error finding container 5b89ae6546a87a5241ea1e6b53b9cdcf772957131318e0f9432f73ec65b00ce3: Status 404 returned error can't find the container with id 5b89ae6546a87a5241ea1e6b53b9cdcf772957131318e0f9432f73ec65b00ce3
Sep 19 01:12:38.441285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.440977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:38.441285 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.441261    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:38.441489 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.441333    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:40.44131492 +0000 UTC m=+7.782762835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:38.441489 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.441353    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:38.441489 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.441406    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:12:40.441390125 +0000 UTC m=+7.782838045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:38.441489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.441268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:38.542220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.542182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:38.542399 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.542383    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:38.542456 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.542401    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:38.542456 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.542413    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:38.542559 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.542467    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:40.542451411 +0000 UTC m=+7.883899317 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:38.873383 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.873271    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 01:07:36 +0000 UTC" deadline="2028-03-11 22:18:33.926846767 +0000 UTC"
Sep 19 01:12:38.873383 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.873332    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12957h5m55.053518584s"
Sep 19 01:12:38.915144 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.915114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:38.915338 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.915256    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:38.915657 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.915634    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:38.915759 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.915726    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:38.915827 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.915786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:38.915883 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:38.915865    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:38.938704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.938678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9pcc" event={"ID":"20195353-0cae-4439-86ae-9be858e3b5d1","Type":"ContainerStarted","Data":"0f8619230b540714ed6fbffa988a80d8896adb9ccdba231125d86f57ec3bef38"}
Sep 19 01:12:38.947625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.947572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"13552863c1c9dcef07cf835528a9513e512e30e1caa7a5c880d3157719fba5f4"}
Sep 19 01:12:38.956113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.955966    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4rrbn" event={"ID":"b867204f-1ec7-4775-b034-0e1e9cb5d7cd","Type":"ContainerStarted","Data":"dd2c560482ce04299db12b508bfcf2c0bcf74badf05ce4eb216e65b95a665950"}
Sep 19 01:12:38.975443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.975417    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal" event={"ID":"f301cdf4e0c29dc70eeb444d9a4d1da3","Type":"ContainerStarted","Data":"98173834ac128198746486e6fb8b9c66eaacec0b0a814eb1f1b207fdfb1b51b6"}
Sep 19 01:12:38.987550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.987462    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-khzzp" event={"ID":"8c361331-b5c0-4bb1-921d-0ae317043067","Type":"ContainerStarted","Data":"4f096a7593c004d7e314ad572f96b2ebfca6c3261e48f054990b68bea4797782"}
Sep 19 01:12:38.992198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.992095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6rcls" event={"ID":"c48076c9-eb3e-4732-8270-ee9708243caf","Type":"ContainerStarted","Data":"ab6a7a5c60977616892c7b1164625f4a507acce70f46edf5233657935fb9bb83"}
Sep 19 01:12:38.993963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.993562    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-9.ec2.internal" podStartSLOduration=2.993526593 podStartE2EDuration="2.993526593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:38.992761417 +0000 UTC m=+6.334209338" watchObservedRunningTime="2026-09-19 01:12:38.993526593 +0000 UTC m=+6.334974518"
Sep 19 01:12:38.993963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.993822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9" event={"ID":"43455aa2-fd0e-4ae0-8858-e4a2675ce085","Type":"ContainerStarted","Data":"5b89ae6546a87a5241ea1e6b53b9cdcf772957131318e0f9432f73ec65b00ce3"}
Sep 19 01:12:38.996669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:38.996572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6288" event={"ID":"47de3ad7-4204-475c-ab73-3717af51f00a","Type":"ContainerStarted","Data":"08937293d7691574f63a63eae27ca87a445ca9c2ad81f259658dce325747f128"}
Sep 19 01:12:39.009351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:39.009327    2567 generic.go:356] "Generic (PLEG): container finished" podID="814f2712dfe69728a741fedc9dfa521c" containerID="eb64cb42a301bf2fa84cb6c3b54f333763031a30388d78d69508da78c30d074c" exitCode=0
Sep 19 01:12:39.009528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:39.009399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal" event={"ID":"814f2712dfe69728a741fedc9dfa521c","Type":"ContainerDied","Data":"eb64cb42a301bf2fa84cb6c3b54f333763031a30388d78d69508da78c30d074c"}
Sep 19 01:12:39.034774 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:39.034670    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerStarted","Data":"8dc91636a28d84b1ebee75402386af8facb8926435274400be5bfc5d893aa302"}
Sep 19 01:12:39.043616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:39.043563    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2q64x" event={"ID":"e98f12d3-21a6-4761-9bd4-31fe87a862e8","Type":"ContainerStarted","Data":"80315f9d755f42cd4c98773aff99341576f132b10b716ad018179091ebe7cac6"}
Sep 19 01:12:40.056709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.056674    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal" event={"ID":"814f2712dfe69728a741fedc9dfa521c","Type":"ContainerStarted","Data":"773bcdc7de07127b6f69216f70a2f663c27fbd47bb97d736b23be3a353073195"}
Sep 19 01:12:40.074021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.073511    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-9.ec2.internal" podStartSLOduration=4.073492205 podStartE2EDuration="4.073492205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:40.072981369 +0000 UTC m=+7.414429295" watchObservedRunningTime="2026-09-19 01:12:40.073492205 +0000 UTC m=+7.414940130"
Sep 19 01:12:40.464267 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.464159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:40.464267 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.464212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:40.464490 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.464328    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:40.464490 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.464360    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:40.464490 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.464407    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:44.464387645 +0000 UTC m=+11.805835563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:40.464490 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.464427    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:12:44.464417077 +0000 UTC m=+11.805864980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:40.564821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.564785    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:40.565032 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.564951    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:40.565032 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.564971    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:40.565032 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.564983    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:40.565213 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.565045    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:44.565027496 +0000 UTC m=+11.906475403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:40.919675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.919589    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:40.919675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.919603    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:40.919891 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.919712    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:40.919891 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.919772    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:40.919891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:40.919825    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:40.920070 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:40.919912    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:42.914495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:42.914460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:42.914983 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:42.914568    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:42.914983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:42.914748    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:42.914983 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:42.914854    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:42.914983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:42.914912    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:42.915266 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:42.914998    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.497134    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.497229    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.497294    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.497331    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.497367    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:12:52.497346836 +0000 UTC m=+19.838794760 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:44.497383 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.497388    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:52.497378747 +0000 UTC m=+19.838826647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:44.598107 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.598070    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:44.598337 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.598226    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:44.598337 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.598247    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:44.598337 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.598260    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:44.598337 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.598319    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:12:52.598300708 +0000 UTC m=+19.939748612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:44.918478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.918410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:44.918621 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.918525    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:44.918621 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.918536    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:44.918728 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.918629    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:44.918728 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:44.918679    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:44.918825 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:44.918729    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:46.915258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:46.915220    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:46.915823 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:46.915221    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:46.915823 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:46.915351    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:46.915823 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:46.915221    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:46.915823 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:46.915446    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:46.915823 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:46.915509    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:48.915065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:48.915030    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:48.915501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:48.915037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:48.915501 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:48.915166    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:48.915501 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:48.915253    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:48.915501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:48.915037    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:48.915501 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:48.915359    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:50.914809 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:50.914775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:50.915294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:50.914775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:50.915294 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:50.914904    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:50.915294 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:50.915013    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:50.915294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:50.915079    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:50.915294 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:50.915152    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:52.559052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.559014    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:52.559480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.559067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:52.559480 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.559190    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:52.559480 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.559211    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:52.559480 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.559266    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:08.559245955 +0000 UTC m=+35.900693861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:12:52.559480 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.559288    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:13:08.559277133 +0000 UTC m=+35.900725040 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:12:52.660021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.659990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:52.660176 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.660155    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:12:52.660217 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.660185    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:12:52.660217 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.660196    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:52.660292 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.660248    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:08.66023156 +0000 UTC m=+36.001679477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:12:52.915205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.915113    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:52.915205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.915152    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:52.915421 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:52.915112    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:52.915421 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.915242    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:52.915421 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.915344    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:52.915576 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:52.915426    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:54.915803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:54.915775    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:54.916174 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:54.915870    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:54.916174 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:54.915879    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:54.916174 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:54.915977    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:54.916174 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:54.916027    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:54.916174 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:54.916076    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:56.086939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.086649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4rrbn" event={"ID":"b867204f-1ec7-4775-b034-0e1e9cb5d7cd","Type":"ContainerStarted","Data":"d51b614b1e9e1efa007eceb4cf2a54fe5c6c9e15aba087969e9db1660a561f96"}
Sep 19 01:12:56.088355 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.088326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-khzzp" event={"ID":"8c361331-b5c0-4bb1-921d-0ae317043067","Type":"ContainerStarted","Data":"72a7ebf3945d37f89b7d629f18227c8fd37fafcdc81bc13324405e20d85b97fa"}
Sep 19 01:12:56.089850 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.089821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6rcls" event={"ID":"c48076c9-eb3e-4732-8270-ee9708243caf","Type":"ContainerStarted","Data":"56b7aa5181c8a1bf1c224195503e6fc073fc07a8d8d788ac5e71f02255601926"}
Sep 19 01:12:56.091389 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.091365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9" event={"ID":"43455aa2-fd0e-4ae0-8858-e4a2675ce085","Type":"ContainerStarted","Data":"4f6f669c64e52a18ea2e86f47d854119bf01cce5018bac617d22ede038f0eb71"}
Sep 19 01:12:56.092864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.092843    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="9fafa87a780087edd7f7b0bd2d52dd51116be8fb60add504777895905bd2c485" exitCode=0
Sep 19 01:12:56.092968 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.092892    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"9fafa87a780087edd7f7b0bd2d52dd51116be8fb60add504777895905bd2c485"}
Sep 19 01:12:56.094488 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.094464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2q64x" event={"ID":"e98f12d3-21a6-4761-9bd4-31fe87a862e8","Type":"ContainerStarted","Data":"ec6051a2a0a65f6bec30fbc7609bc6a1c5423d51052b8966e45dc32c8ee60e5b"}
Sep 19 01:12:56.096264 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.096244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9pcc" event={"ID":"20195353-0cae-4439-86ae-9be858e3b5d1","Type":"ContainerStarted","Data":"246609eb96156715e4f7c546db482b61aac637b29c8510feec8a3f1b52069c4c"}
Sep 19 01:12:56.099555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.099481    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:12:56.101855 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.101831    2567 generic.go:356] "Generic (PLEG): container finished" podID="5911355c-4a74-44c6-a895-24e17ee6e7b5" containerID="7aead033343a91fe84fbc0732aa36b671a621b120307a0946871d287ea7ddddc" exitCode=1
Sep 19 01:12:56.101958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.101865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"471a6317a2275363400479a01117a08bd36d2a0f9f0cb895eb73ca94627842b8"}
Sep 19 01:12:56.101958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.101953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"f6a7621cbbf309115961b890868cdd694b0cfbaeca567fa919dfc819fe782bc1"}
Sep 19 01:12:56.102032 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.102003    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"a09b2037a50e0f5c894d11b128ce440ca04fbe8fe81a9960056c0f8ecb16e045"}
Sep 19 01:12:56.102062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.102052    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"fa0c15c18dbc8c707c2fbbe628b95da83f177d823d8ffbd906d7ca67a1df8699"}
Sep 19 01:12:56.102111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.102098    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerDied","Data":"7aead033343a91fe84fbc0732aa36b671a621b120307a0946871d287ea7ddddc"}
Sep 19 01:12:56.102157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.102151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"e7e6f264ed30f60cf3067f08729e2d2403b11a6060a7e015a0ed55c974b8b987"}
Sep 19 01:12:56.112005 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.111961    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4rrbn" podStartSLOduration=4.002981556 podStartE2EDuration="21.111949896s" totalImagesPullingTime="17.10896834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:56.111404129 +0000 UTC m=+23.452852054" watchObservedRunningTime="2026-09-19 01:12:56.111949896 +0000 UTC m=+23.453397818"
Sep 19 01:12:56.135278 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.135237    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v9pcc" podStartSLOduration=4.026960697 podStartE2EDuration="21.135220806s" totalImagesPullingTime="17.108260109s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:56.13379829 +0000 UTC m=+23.475246213" watchObservedRunningTime="2026-09-19 01:12:56.135220806 +0000 UTC m=+23.476668730"
Sep 19 01:12:56.156099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.156059    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2q64x" podStartSLOduration=4.053645332 podStartE2EDuration="21.156042327s" totalImagesPullingTime="17.102396995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:56.155475537 +0000 UTC m=+23.496923460" watchObservedRunningTime="2026-09-19 01:12:56.156042327 +0000 UTC m=+23.497490292"
Sep 19 01:12:56.179212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.179178    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-khzzp" podStartSLOduration=4.036254749 podStartE2EDuration="21.179169465s" totalImagesPullingTime="17.142914716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:56.17910823 +0000 UTC m=+23.520556155" watchObservedRunningTime="2026-09-19 01:12:56.179169465 +0000 UTC m=+23.520617387"
Sep 19 01:12:56.232655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.232611    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6rcls" podStartSLOduration=8.137149067 podStartE2EDuration="21.232593611s" totalImagesPullingTime="13.095444544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:56.232098386 +0000 UTC m=+23.573546311" watchObservedRunningTime="2026-09-19 01:12:56.232593611 +0000 UTC m=+23.574041534"
Sep 19 01:12:56.288543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.288526    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 01:12:56.886748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.886497    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T01:12:56.288539126Z","UUID":"c79be15c-db61-44dc-ae99-eecbf57e7c65","Handler":null,"Name":"","Endpoint":""}
Sep 19 01:12:56.888534 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.888495    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 01:12:56.888534 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.888530    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 01:12:56.914614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.914556    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:56.914614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.914591    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:56.914793 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:56.914665    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:56.914793 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:56.914720    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:56.914903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:56.914804    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:56.914903 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:56.914889    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:57.106862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:57.106820    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9" event={"ID":"43455aa2-fd0e-4ae0-8858-e4a2675ce085","Type":"ContainerStarted","Data":"af1cc5013653f07f33f7110ac85d0651f41daf745d3e8b572a0577aa1be7f338"}
Sep 19 01:12:57.109178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:57.108637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6288" event={"ID":"47de3ad7-4204-475c-ab73-3717af51f00a","Type":"ContainerStarted","Data":"8883cd14b925980f96441f7c86f2feacfb26f07eabe02d3904c94bb840a0d856"}
Sep 19 01:12:57.128675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:57.128625    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p6288" podStartSLOduration=6.01763567 podStartE2EDuration="23.128608152s" totalImagesPullingTime="17.110972482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:57.128088849 +0000 UTC m=+24.469536771" watchObservedRunningTime="2026-09-19 01:12:57.128608152 +0000 UTC m=+24.470056077"
Sep 19 01:12:58.113802 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.113774    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:12:58.114248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.114220    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"f4d4a6c10b4bc191d3513a116d24665899212fa8188df752b08cf825f88d8efd"}
Sep 19 01:12:58.116635 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.116604    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9" event={"ID":"43455aa2-fd0e-4ae0-8858-e4a2675ce085","Type":"ContainerStarted","Data":"044876108c0be5dedba95a7a553165ce6a01fd07ccf6b0a34d3e4261a2c2cdbb"}
Sep 19 01:12:58.136969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.136930    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-967j9" podStartSLOduration=4.305749229 podStartE2EDuration="23.136900909s" totalImagesPullingTime="18.83115168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:12:58.136356406 +0000 UTC m=+25.477804329" watchObservedRunningTime="2026-09-19 01:12:58.136900909 +0000 UTC m=+25.478348832"
Sep 19 01:12:58.915374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.915345    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:12:58.915588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.915353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:12:58.915588 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:58.915468    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:12:58.915588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:58.915353    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:12:58.915588 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:58.915525    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:12:58.915800 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:12:58.915605    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:12:59.702861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:59.702826    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:12:59.703516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:12:59.703500    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:13:00.124661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.124640    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:13:00.125027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.124984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"1357fd305e11a43a1e0a1ac99289d26bb0d29d4b315420d2a42046271e7ec1fa"}
Sep 19 01:13:00.125222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.125201    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:13:00.125476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.125458    2567 scope.go:117] "RemoveContainer" containerID="7aead033343a91fe84fbc0732aa36b671a621b120307a0946871d287ea7ddddc"
Sep 19 01:13:00.125681 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.125663    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6rcls"
Sep 19 01:13:00.914999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.914738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:00.915615 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.914738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:00.915615 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:00.915103    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:13:00.915615 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:00.914738    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:00.915615 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:00.915154    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:13:00.915615 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:00.915221    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:13:01.128523 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.128489    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="b2d623d81f30404930549af94906cec06cd7f21c2302245a928a7f2efa06787a" exitCode=0
Sep 19 01:13:01.128658 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.128573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"b2d623d81f30404930549af94906cec06cd7f21c2302245a928a7f2efa06787a"}
Sep 19 01:13:01.132375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.132358    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:13:01.132742 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.132717    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" event={"ID":"5911355c-4a74-44c6-a895-24e17ee6e7b5","Type":"ContainerStarted","Data":"07b8a8b323a4fed75634282741161ded00defb32c296eff7fe2835ab595f9b34"}
Sep 19 01:13:01.133099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.133088    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:01.133172 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.133153    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:01.133224 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.133212    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:01.149733 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.149715    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:01.149967 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.149953    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:01.978043 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.977992    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2" podStartSLOduration=10.848479414 podStartE2EDuration="27.977975122s" totalImagesPullingTime="17.129495708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:01.219541917 +0000 UTC m=+28.560989839" watchObservedRunningTime="2026-09-19 01:13:01.977975122 +0000 UTC m=+29.319423044"
Sep 19 01:13:01.978477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.978266    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7mpf"]
Sep 19 01:13:01.978477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.978402    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:01.978558 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:01.978482    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:13:01.980942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.980870    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbmjk"]
Sep 19 01:13:01.981048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.981005    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:01.981109 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:01.981088    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:13:01.981568 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.981547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p58b7"]
Sep 19 01:13:01.981674 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:01.981638    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:01.981750 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:01.981729    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:13:03.139406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:03.139376    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="eb7516f0d474ce358fad7969d553a494631aa409b938d54b4137c80bb6198571" exitCode=0
Sep 19 01:13:03.139770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:03.139419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"eb7516f0d474ce358fad7969d553a494631aa409b938d54b4137c80bb6198571"}
Sep 19 01:13:03.915665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:03.915434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:03.915775 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:03.915475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:03.915819 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:03.915777    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:13:03.915869 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:03.915475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:03.915869 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:03.915840    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:13:03.915983 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:03.915937    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:13:05.144665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:05.144630    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="b62d9502214c5356608aa2dd732801ad270cbfadb1c62b400fdf28e693a501a3" exitCode=0
Sep 19 01:13:05.145072 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:05.144687    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"b62d9502214c5356608aa2dd732801ad270cbfadb1c62b400fdf28e693a501a3"}
Sep 19 01:13:05.915440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:05.915401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:05.915645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:05.915446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:05.915645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:05.915446    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:05.915645 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:05.915569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:13:05.915645 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:05.915635    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:13:05.915897 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:05.915635    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:13:06.003359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:06.003327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:06.135034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:06.134997    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:07.636419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.636390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:07.740904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.740862    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:07.845197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.845151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:07.914740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.914671    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:07.914740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.914711    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:07.914935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.914771    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:07.914935 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:07.914789    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-p58b7" podUID="0c9a1446-5387-4dcc-8ffd-61865b20b704"
Sep 19 01:13:07.914935 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:07.914867    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dbmjk" podUID="65420911-0e63-4656-9460-51311cf8e4fb"
Sep 19 01:13:07.915103 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:07.914946    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f7mpf" podUID="15c31a0b-130b-406d-b4c6-899372d9cec5"
Sep 19 01:13:07.941827 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:07.941770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:08.582430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:08.582396    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:08.582644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:08.582440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:08.582644 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.582560    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 01:13:08.582644 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.582576    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:13:08.582644 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.582617    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret podName:0c9a1446-5387-4dcc-8ffd-61865b20b704 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:40.582602813 +0000 UTC m=+67.924050713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret") pod "global-pull-secret-syncer-p58b7" (UID: "0c9a1446-5387-4dcc-8ffd-61865b20b704") : object "kube-system"/"original-pull-secret" not registered
Sep 19 01:13:08.582644 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.582633    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs podName:65420911-0e63-4656-9460-51311cf8e4fb nodeName:}" failed. No retries permitted until 2026-09-19 01:13:40.582625879 +0000 UTC m=+67.924073780 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs") pod "network-metrics-daemon-dbmjk" (UID: "65420911-0e63-4656-9460-51311cf8e4fb") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 01:13:08.683467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:08.683438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:08.683846 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.683597    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 01:13:08.683846 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.683615    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 01:13:08.683846 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.683624    2567 projected.go:196] Error preparing data for projected volume kube-api-access-dzk7m for pod openshift-network-diagnostics/network-check-target-f7mpf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:13:08.683846 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:08.683673    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m podName:15c31a0b-130b-406d-b4c6-899372d9cec5 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:40.683657878 +0000 UTC m=+68.025105799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dzk7m" (UniqueName: "kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m") pod "network-check-target-f7mpf" (UID: "15c31a0b-130b-406d-b4c6-899372d9cec5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 01:13:09.159210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.159185    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-9.ec2.internal" event="NodeReady"
Sep 19 01:13:09.159366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.159299    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 01:13:09.255558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.254960    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2j7fz"]
Sep 19 01:13:09.270409 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.270388    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.270560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.270396    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wj866"]
Sep 19 01:13:09.287326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.287307    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 01:13:09.287411 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.287313    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-spc29\""
Sep 19 01:13:09.287411 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.287332    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 01:13:09.296638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.296621    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2j7fz"]
Sep 19 01:13:09.296719 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.296698    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.302059 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.302034    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 01:13:09.302157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.302034    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 01:13:09.302220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.302149    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 01:13:09.302380 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.302368    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h9l7c\""
Sep 19 01:13:09.313720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.313703    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wj866"]
Sep 19 01:13:09.388389 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-cert\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.388501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388393    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56cpv\" (UniqueName: \"kubernetes.io/projected/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-kube-api-access-56cpv\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.388501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a25efb0c-3626-4adf-aa67-386fc1ad148d-config-volume\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.388501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a25efb0c-3626-4adf-aa67-386fc1ad148d-tmp-dir\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.388634 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrk5\" (UniqueName: \"kubernetes.io/projected/a25efb0c-3626-4adf-aa67-386fc1ad148d-kube-api-access-bjrk5\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.388634 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.388551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489219    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-cert\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.489269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56cpv\" (UniqueName: \"kubernetes.io/projected/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-kube-api-access-56cpv\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.489269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a25efb0c-3626-4adf-aa67-386fc1ad148d-config-volume\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a25efb0c-3626-4adf-aa67-386fc1ad148d-tmp-dir\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrk5\" (UniqueName: \"kubernetes.io/projected/a25efb0c-3626-4adf-aa67-386fc1ad148d-kube-api-access-bjrk5\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489465 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:09.489394    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 01:13:09.489465 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:09.489448    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls podName:a25efb0c-3626-4adf-aa67-386fc1ad148d nodeName:}" failed. No retries permitted until 2026-09-19 01:13:09.989430436 +0000 UTC m=+37.330878338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls") pod "dns-default-wj866" (UID: "a25efb0c-3626-4adf-aa67-386fc1ad148d") : secret "dns-default-metrics-tls" not found
Sep 19 01:13:09.489706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a25efb0c-3626-4adf-aa67-386fc1ad148d-tmp-dir\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.489847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.489822    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a25efb0c-3626-4adf-aa67-386fc1ad148d-config-volume\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.493303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.493282    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-cert\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.501170 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.501148    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56cpv\" (UniqueName: \"kubernetes.io/projected/98c1ff6e-a7b0-4487-a59a-8b1905ddca1a-kube-api-access-56cpv\") pod \"ingress-canary-2j7fz\" (UID: \"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a\") " pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.501252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.501242    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrk5\" (UniqueName: \"kubernetes.io/projected/a25efb0c-3626-4adf-aa67-386fc1ad148d-kube-api-access-bjrk5\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.580275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.580254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2j7fz"
Sep 19 01:13:09.900698 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.900539    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"]
Sep 19 01:13:09.920602 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:09.920576    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98c1ff6e_a7b0_4487_a59a_8b1905ddca1a.slice/crio-f206beed8a6a9d855d27f436470cccf4d7e1b764ef831cefdb4d01ca5432720d WatchSource:0}: Error finding container f206beed8a6a9d855d27f436470cccf4d7e1b764ef831cefdb4d01ca5432720d: Status 404 returned error can't find the container with id f206beed8a6a9d855d27f436470cccf4d7e1b764ef831cefdb4d01ca5432720d
Sep 19 01:13:09.923533 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923512    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2j7fz"]
Sep 19 01:13:09.923652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923542    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"]
Sep 19 01:13:09.923652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923591    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:09.923753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:09.923883 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:09.924009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.923596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:09.934036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.933779    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f5jnh\""
Sep 19 01:13:09.934036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.933975    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lthdr\""
Sep 19 01:13:09.934210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.934017    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 19 01:13:09.934210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.934097    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2nstq\""
Sep 19 01:13:09.935333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.935112    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 19 01:13:09.935333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.935252    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 01:13:09.935333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.935307    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 01:13:09.935333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.935317    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 01:13:09.935556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.935402    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 01:13:09.993800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:09.993773    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:09.993934 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:09.993904    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 01:13:09.993989 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:09.993972    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls podName:a25efb0c-3626-4adf-aa67-386fc1ad148d nodeName:}" failed. No retries permitted until 2026-09-19 01:13:10.993958203 +0000 UTC m=+38.335406109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls") pod "dns-default-wj866" (UID: "a25efb0c-3626-4adf-aa67-386fc1ad148d") : secret "dns-default-metrics-tls" not found
Sep 19 01:13:10.094682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.094657    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.094794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.094773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.156572 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.156542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2j7fz" event={"ID":"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a","Type":"ContainerStarted","Data":"f206beed8a6a9d855d27f436470cccf4d7e1b764ef831cefdb4d01ca5432720d"}
Sep 19 01:13:10.159215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.159191    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="5afe488cde4d3ee1cdd206d9ca4246b208cd352c2dd6566898a6f9d4454701c9" exitCode=0
Sep 19 01:13:10.159304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.159241    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"5afe488cde4d3ee1cdd206d9ca4246b208cd352c2dd6566898a6f9d4454701c9"}
Sep 19 01:13:10.195418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.195395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.195506 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.195439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.195573 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:10.195546    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:10.195628 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:10.195613    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:10.695593495 +0000 UTC m=+38.037041420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:10.196498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.196088    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.329447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.329419    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:10.400620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.400590    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:10.532086 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.532052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:10.629787 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.629711    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:10.700182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.700159    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:10.700346 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:10.700328    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:10.700417 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:10.700406    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:11.700383808 +0000 UTC m=+39.041831715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:10.989834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:10.989756    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:11.003286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.003258    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:11.003439 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:11.003420    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 01:13:11.003504 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:11.003491    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls podName:a25efb0c-3626-4adf-aa67-386fc1ad148d nodeName:}" failed. No retries permitted until 2026-09-19 01:13:13.0034721 +0000 UTC m=+40.344920001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls") pod "dns-default-wj866" (UID: "a25efb0c-3626-4adf-aa67-386fc1ad148d") : secret "dns-default-metrics-tls" not found
Sep 19 01:13:11.091761 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.091723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:11.165407 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.165364    2567 generic.go:356] "Generic (PLEG): container finished" podID="7cdb9229-feb5-449c-837d-7d3917c98aef" containerID="643a6d4616fc779000893fc4feff0d5ff747d1d4ba12a9f8e29b2429405b9a43" exitCode=0
Sep 19 01:13:11.165570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.165407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerDied","Data":"643a6d4616fc779000893fc4feff0d5ff747d1d4ba12a9f8e29b2429405b9a43"}
Sep 19 01:13:11.556877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.556844    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:11.574558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.574531    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"]
Sep 19 01:13:11.602803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.602776    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"
Sep 19 01:13:11.614090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.614070    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 19 01:13:11.626262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.626241    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 19 01:13:11.626587 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.626572    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hmt84\""
Sep 19 01:13:11.653230 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.653205    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"]
Sep 19 01:13:11.707182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.707155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:11.707296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.707218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rknk2\" (UniqueName: \"kubernetes.io/projected/68648148-0ad9-4533-86db-1061062b22ba-kube-api-access-rknk2\") pod \"migrator-76794cbd6c-k7jjx\" (UID: \"68648148-0ad9-4533-86db-1061062b22ba\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"
Sep 19 01:13:11.707367 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:11.707346    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:11.707496 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:11.707415    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:13.707396435 +0000 UTC m=+41.048844343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:11.798080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.798050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:11.807903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.807877    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rknk2\" (UniqueName: \"kubernetes.io/projected/68648148-0ad9-4533-86db-1061062b22ba-kube-api-access-rknk2\") pod \"migrator-76794cbd6c-k7jjx\" (UID: \"68648148-0ad9-4533-86db-1061062b22ba\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"
Sep 19 01:13:11.825493 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.825471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rknk2\" (UniqueName: \"kubernetes.io/projected/68648148-0ad9-4533-86db-1061062b22ba-kube-api-access-rknk2\") pod \"migrator-76794cbd6c-k7jjx\" (UID: \"68648148-0ad9-4533-86db-1061062b22ba\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"
Sep 19 01:13:11.912717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.912680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"
Sep 19 01:13:11.925724 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.925692    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:11.949498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.949474    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4tfrj"]
Sep 19 01:13:11.959827 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.959808    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:11.964933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.964901    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 01:13:11.965096 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.965074    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 01:13:11.965260 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.965237    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pqfkn\""
Sep 19 01:13:11.965346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.965249    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 01:13:11.965521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.965494    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 01:13:11.978115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:11.978093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4tfrj"]
Sep 19 01:13:12.110117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.110038    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02824a2-1799-447d-bd98-d4eff0752e0a-data-volume\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.110117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.110084    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.110584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.110124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02824a2-1799-447d-bd98-d4eff0752e0a-crio-socket\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.110584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.110144    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.110584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.110251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsczh\" (UniqueName: \"kubernetes.io/projected/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-api-access-vsczh\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.172188 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.172157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-849st" event={"ID":"7cdb9229-feb5-449c-837d-7d3917c98aef","Type":"ContainerStarted","Data":"c9bca5cfc2a2e8df2cfdd7a14bab0a2e0a426a4e43ca650ed60f88a8747c81bc"}
Sep 19 01:13:12.198079 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.198033    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-849st" podStartSLOduration=9.376273207 podStartE2EDuration="37.198018388s" totalImagesPullingTime="27.821745181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:12.19637069 +0000 UTC m=+39.537818614" watchObservedRunningTime="2026-09-19 01:13:12.198018388 +0000 UTC m=+39.539466311"
Sep 19 01:13:12.210695 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02824a2-1799-447d-bd98-d4eff0752e0a-crio-socket\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.210788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210703    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.210788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsczh\" (UniqueName: \"kubernetes.io/projected/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-api-access-vsczh\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.210865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210806    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02824a2-1799-447d-bd98-d4eff0752e0a-data-volume\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.210865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.210951 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.210891    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:12.210951 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.210908    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 01:13:12.210951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.210938    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f02824a2-1799-447d-bd98-d4eff0752e0a-crio-socket\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.211084 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.210981    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:12.710966157 +0000 UTC m=+40.052414078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:12.211084 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.211001    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:12.710995895 +0000 UTC m=+40.052443796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : configmap "kube-rbac-proxy" not found
Sep 19 01:13:12.211200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.211105    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f02824a2-1799-447d-bd98-d4eff0752e0a-data-volume\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.219481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.219458    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsczh\" (UniqueName: \"kubernetes.io/projected/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-api-access-vsczh\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.374652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.374590    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:12.510591 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.510561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx"]
Sep 19 01:13:12.511391 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:12.511372    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68648148_0ad9_4533_86db_1061062b22ba.slice/crio-3ef7043b3e9013cb576af46ede0646dacadd20177ec9c0a5d9ea338705386e5f WatchSource:0}: Error finding container 3ef7043b3e9013cb576af46ede0646dacadd20177ec9c0a5d9ea338705386e5f: Status 404 returned error can't find the container with id 3ef7043b3e9013cb576af46ede0646dacadd20177ec9c0a5d9ea338705386e5f
Sep 19 01:13:12.584390 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.584357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:12.684064 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.683978    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:12.715002 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.714973    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.715126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:12.715016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:12.715126 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.715084    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 01:13:12.715126 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.715124    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:12.715243 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.715144    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:13.715125704 +0000 UTC m=+41.056573604 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : configmap "kube-rbac-proxy" not found
Sep 19 01:13:12.715243 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:12.715173    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:13.715162438 +0000 UTC m=+41.056610339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:13.017127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.017043    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:13.017344 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.017213    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 01:13:13.017344 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.017290    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls podName:a25efb0c-3626-4adf-aa67-386fc1ad148d nodeName:}" failed. No retries permitted until 2026-09-19 01:13:17.017271526 +0000 UTC m=+44.358719440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls") pod "dns-default-wj866" (UID: "a25efb0c-3626-4adf-aa67-386fc1ad148d") : secret "dns-default-metrics-tls" not found
Sep 19 01:13:13.176794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.176754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2j7fz" event={"ID":"98c1ff6e-a7b0-4487-a59a-8b1905ddca1a","Type":"ContainerStarted","Data":"9d35487190be6e40246dd671f45533b1a7ee24f28a40d127b292c16af7c6cab3"}
Sep 19 01:13:13.178151 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.178125    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx" event={"ID":"68648148-0ad9-4533-86db-1061062b22ba","Type":"ContainerStarted","Data":"3ef7043b3e9013cb576af46ede0646dacadd20177ec9c0a5d9ea338705386e5f"}
Sep 19 01:13:13.235364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.235318    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2j7fz" podStartSLOduration=1.7696521010000001 podStartE2EDuration="4.235300287s" totalImagesPullingTime="2.465648186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:13.234805881 +0000 UTC m=+40.576253805" watchObservedRunningTime="2026-09-19 01:13:13.235300287 +0000 UTC m=+40.576748211"
Sep 19 01:13:13.291241 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.291217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:13.419730 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.419697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:13.723097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.722872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:13.723097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.723083    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.723110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723033    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723185    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:17.723169644 +0000 UTC m=+45.064617545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723193    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723237    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723240    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:15.723228762 +0000 UTC m=+43.064676663 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : configmap "kube-rbac-proxy" not found
Sep 19 01:13:13.723290 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:13.723284    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:15.723274932 +0000 UTC m=+43.064722838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:13.784564 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.784532    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:13.988097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:13.988029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:14.182127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.182104    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx" event={"ID":"68648148-0ad9-4533-86db-1061062b22ba","Type":"ContainerStarted","Data":"ee7b52d395cbe37bbfe90a26ee2b74b7181565436ce2e620ee822797da2e13d6"}
Sep 19 01:13:14.466486 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.466464    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4rrbn_b867204f-1ec7-4775-b034-0e1e9cb5d7cd/dns-node-resolver/0.log"
Sep 19 01:13:14.889744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.889712    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dnk7f"]
Sep 19 01:13:14.891433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.891414    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:14.899771 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.899747    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 19 01:13:14.899867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.899813    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xzpxx\""
Sep 19 01:13:14.899867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.899816    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 19 01:13:14.900574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.900560    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 19 01:13:14.900633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.900575    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 19 01:13:14.929209 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.929183    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dnk7f"]
Sep 19 01:13:14.964931 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:14.964897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:15.031846 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.031825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-key\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.031936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.031863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvbcz\" (UniqueName: \"kubernetes.io/projected/67f28a68-b2fb-4a38-91d7-ac57810e59d2-kube-api-access-pvbcz\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.031936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.031886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-cabundle\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.100799 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.100766    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:15.133254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.133230    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-key\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.133357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.133272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvbcz\" (UniqueName: \"kubernetes.io/projected/67f28a68-b2fb-4a38-91d7-ac57810e59d2-kube-api-access-pvbcz\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.133357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.133298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-cabundle\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.133954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.133911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-cabundle\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.135930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.135898    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/67f28a68-b2fb-4a38-91d7-ac57810e59d2-signing-key\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.149817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.149767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvbcz\" (UniqueName: \"kubernetes.io/projected/67f28a68-b2fb-4a38-91d7-ac57810e59d2-kube-api-access-pvbcz\") pod \"service-ca-55f6fc7b86-dnk7f\" (UID: \"67f28a68-b2fb-4a38-91d7-ac57810e59d2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.186095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.186073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx" event={"ID":"68648148-0ad9-4533-86db-1061062b22ba","Type":"ContainerStarted","Data":"6c32790253fe735d9f704836d2cc8b2a6b8723922fddba999fca89024d3cd9fe"}
Sep 19 01:13:15.199667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.199651    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f"
Sep 19 01:13:15.220715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.220675    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-k7jjx" podStartSLOduration=2.675106736 podStartE2EDuration="4.220660526s" totalImagesPullingTime="1.54555379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:15.220230422 +0000 UTC m=+42.561678344" watchObservedRunningTime="2026-09-19 01:13:15.220660526 +0000 UTC m=+42.562108450"
Sep 19 01:13:15.425053 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.424975    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:15.459879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.459857    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2q64x_e98f12d3-21a6-4761-9bd4-31fe87a862e8/node-ca/0.log"
Sep 19 01:13:15.515266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.515241    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-dnk7f"]
Sep 19 01:13:15.518517 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:15.518479    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f28a68_b2fb_4a38_91d7_ac57810e59d2.slice/crio-e972ef5c63010b2146e5a77cb6734783456739fd8a230f2f5fe72b27b88796a4 WatchSource:0}: Error finding container e972ef5c63010b2146e5a77cb6734783456739fd8a230f2f5fe72b27b88796a4: Status 404 returned error can't find the container with id e972ef5c63010b2146e5a77cb6734783456739fd8a230f2f5fe72b27b88796a4
Sep 19 01:13:15.627721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.627693    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:15.738278 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.738233    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:15.738390 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:15.738372    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:15.738445 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:15.738434    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:19.738416065 +0000 UTC m=+47.079863989 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:15.738487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:15.738416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:15.738526 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:15.738514    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 01:13:15.738568 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:15.738559    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:19.738547193 +0000 UTC m=+47.079995093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : configmap "kube-rbac-proxy" not found
Sep 19 01:13:16.190765 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:16.190724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f" event={"ID":"67f28a68-b2fb-4a38-91d7-ac57810e59d2","Type":"ContainerStarted","Data":"e972ef5c63010b2146e5a77cb6734783456739fd8a230f2f5fe72b27b88796a4"}
Sep 19 01:13:16.257228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:16.257196    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2j7fz_98c1ff6e-a7b0-4487-a59a-8b1905ddca1a/serve-healthcheck-canary/0.log"
Sep 19 01:13:16.389274 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:16.389238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:16.860194 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:16.860154    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k7jjx_68648148-0ad9-4533-86db-1061062b22ba/migrator/0.log"
Sep 19 01:13:16.977362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:16.977325    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:17.050359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:17.050327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:17.050535 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:17.050488    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 01:13:17.050602 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:17.050561    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls podName:a25efb0c-3626-4adf-aa67-386fc1ad148d nodeName:}" failed. No retries permitted until 2026-09-19 01:13:25.05054177 +0000 UTC m=+52.391989676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls") pod "dns-default-wj866" (UID: "a25efb0c-3626-4adf-aa67-386fc1ad148d") : secret "dns-default-metrics-tls" not found
Sep 19 01:13:17.075338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:17.075301    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k7jjx_68648148-0ad9-4533-86db-1061062b22ba/graceful-termination/0.log"
Sep 19 01:13:17.755243 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:17.755162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:17.755575 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:17.755281    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:17.755575 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:17.755331    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:25.755319126 +0000 UTC m=+53.096767027 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:17.849942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:17.849274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:17.952391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:17.952350    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:18.197514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:18.197477    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f" event={"ID":"67f28a68-b2fb-4a38-91d7-ac57810e59d2","Type":"ContainerStarted","Data":"4c7b577ab031bd7ca2656fc0630e3b505396c96f0cbe873f660f7991102223d9"}
Sep 19 01:13:18.214453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:18.214398    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-dnk7f" podStartSLOduration=2.368543655 podStartE2EDuration="4.214379661s" totalImagesPullingTime="1.845836006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:18.213766458 +0000 UTC m=+45.555214381" watchObservedRunningTime="2026-09-19 01:13:18.214379661 +0000 UTC m=+45.555827586"
Sep 19 01:13:18.585578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:18.585535    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:18.860302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:18.860221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:18.974148 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:18.974113    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:19.090117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.090081    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:19.311711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.311684    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:19.550285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.550254    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:19.772178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.772099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:19.772178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.772139    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:19.772344 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:19.772274    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:19.772344 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:19.772325    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls podName:f02824a2-1799-447d-bd98-d4eff0752e0a nodeName:}" failed. No retries permitted until 2026-09-19 01:13:27.772313263 +0000 UTC m=+55.113761164 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4tfrj" (UID: "f02824a2-1799-447d-bd98-d4eff0752e0a") : secret "insights-runtime-extractor-tls" not found
Sep 19 01:13:19.772600 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:19.772582    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f02824a2-1799-447d-bd98-d4eff0752e0a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:20.534847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:20.534816    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:20.728495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:20.728465    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:20.975031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:20.974955    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:21.183502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:21.183467    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:21.309074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:21.309038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.326972 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.326904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.428491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.428462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.530019 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.529989    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.684670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.684595    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.796308 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.796283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.898268 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.898241    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:22.988600 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:22.988527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:23.101435 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:23.101410    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:23.181222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:23.181187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:23.288912 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:23.288871    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:24.295119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:24.295083    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:24.701283 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:24.701182    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:24.888216 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:24.888158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:25.077229 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.077186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:25.111297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.111269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:25.113557 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.113538    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a25efb0c-3626-4adf-aa67-386fc1ad148d-metrics-tls\") pod \"dns-default-wj866\" (UID: \"a25efb0c-3626-4adf-aa67-386fc1ad148d\") " pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:25.179278 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.179249    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:25.204272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.204248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:25.292792 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.292765    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:25.473001 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.472943    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wj866"]
Sep 19 01:13:25.815896 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:25.815864    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:25.816078 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:25.816004    2567 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 01:13:25.816078 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:25.816062    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert podName:cc9f15ae-63d7-48ee-ba3a-16f63932fa99 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:41.816047786 +0000 UTC m=+69.157495688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-59vn6" (UID: "cc9f15ae-63d7-48ee-ba3a-16f63932fa99") : secret "networking-console-plugin-cert" not found
Sep 19 01:13:26.218967 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:26.218876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj866" event={"ID":"a25efb0c-3626-4adf-aa67-386fc1ad148d","Type":"ContainerStarted","Data":"c66b34f889461c0647b2b36be654752b359acdea496fe34b1d159495efaa4600"}
Sep 19 01:13:26.478373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:26.478282    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:26.680607 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:26.680577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:26.882448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:26.882373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:27.096285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:27.096247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:27.279223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:27.279130    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:27.830341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:27.830266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:27.832429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:27.832406    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f02824a2-1799-447d-bd98-d4eff0752e0a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4tfrj\" (UID: \"f02824a2-1799-447d-bd98-d4eff0752e0a\") " pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:27.871406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:27.871382    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4tfrj"
Sep 19 01:13:28.029678 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.029647    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:28.162373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.162314    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4tfrj"]
Sep 19 01:13:28.165232 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:28.165209    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02824a2_1799_447d_bd98_d4eff0752e0a.slice/crio-b40d2d0743a45d206e69f62b169ce1799439eb1c41c6c97c18140a53213dd97a WatchSource:0}: Error finding container b40d2d0743a45d206e69f62b169ce1799439eb1c41c6c97c18140a53213dd97a: Status 404 returned error can't find the container with id b40d2d0743a45d206e69f62b169ce1799439eb1c41c6c97c18140a53213dd97a
Sep 19 01:13:28.224257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.224227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4tfrj" event={"ID":"f02824a2-1799-447d-bd98-d4eff0752e0a","Type":"ContainerStarted","Data":"b40d2d0743a45d206e69f62b169ce1799439eb1c41c6c97c18140a53213dd97a"}
Sep 19 01:13:28.225864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.225843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj866" event={"ID":"a25efb0c-3626-4adf-aa67-386fc1ad148d","Type":"ContainerStarted","Data":"691b96999676eefe0ad47727d277bbf0360fab927e2fd7397bf49b1aa592135f"}
Sep 19 01:13:28.225959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.225882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wj866" event={"ID":"a25efb0c-3626-4adf-aa67-386fc1ad148d","Type":"ContainerStarted","Data":"fe12cf7ad7329b84f8fb15840397eb3bbc4c8b429245a60f35466df9995676bf"}
Sep 19 01:13:28.226040 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.226023    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:28.248882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.248843    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wj866" podStartSLOduration=17.223030958 podStartE2EDuration="19.248828601s" totalImagesPullingTime="2.025797643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:28.247258034 +0000 UTC m=+55.588705970" watchObservedRunningTime="2026-09-19 01:13:28.248828601 +0000 UTC m=+55.590276523"
Sep 19 01:13:28.281254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.281236    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:28.698481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.698447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:28.884453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:28.884418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:29.083046 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:29.083017    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:29.230472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:29.230449    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4tfrj" event={"ID":"f02824a2-1799-447d-bd98-d4eff0752e0a","Type":"ContainerStarted","Data":"49e27aec07ac0230d5429253f9ae088c419f0825d4d453323d7261861989ebf0"}
Sep 19 01:13:29.368935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:29.368859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:30.236849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:30.236808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4tfrj" event={"ID":"f02824a2-1799-447d-bd98-d4eff0752e0a","Type":"ContainerStarted","Data":"6174d4d929eb78709be6389621f68a7510bb189c79d80759464c86ab94205af4"}
Sep 19 01:13:31.241647 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:31.241570    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4tfrj" event={"ID":"f02824a2-1799-447d-bd98-d4eff0752e0a","Type":"ContainerStarted","Data":"add98592cb8a6356317c57f6c037060e888cd088106c4a8c1ef73ad449f74e06"}
Sep 19 01:13:33.153349 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:33.153322    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zmst2"
Sep 19 01:13:33.184512 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:33.184465    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4tfrj" podStartSLOduration=19.677913817 podStartE2EDuration="22.184450648s" totalImagesPullingTime="2.506536831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:13:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:31.271083355 +0000 UTC m=+58.612531277" watchObservedRunningTime="2026-09-19 01:13:33.184450648 +0000 UTC m=+60.525898571"
Sep 19 01:13:34.867094 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:34.867061    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:34.965946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:34.965901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.119898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.119812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.312238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.312212    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.504384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.504281    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.565112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.565078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.896366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.896320    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:35.965909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:35.965879    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:36.503292 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:36.503263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:36.929542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:36.929513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.024970 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.024941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.368786 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.368742    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.470329 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.470302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.553303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.553279    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.786969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.786946    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:37.852984 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:37.852958    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:38.232653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:38.232582    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wj866"
Sep 19 01:13:40.618890 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.618854    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:40.619270 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.618959    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:40.621666 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.621646    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 01:13:40.622266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.622253    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 01:13:40.631455 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.631426    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65420911-0e63-4656-9460-51311cf8e4fb-metrics-certs\") pod \"network-metrics-daemon-dbmjk\" (UID: \"65420911-0e63-4656-9460-51311cf8e4fb\") " pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:40.631550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.631430    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0c9a1446-5387-4dcc-8ffd-61865b20b704-original-pull-secret\") pod \"global-pull-secret-syncer-p58b7\" (UID: \"0c9a1446-5387-4dcc-8ffd-61865b20b704\") " pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:40.719734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.719708    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:40.722335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.722319    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 01:13:40.732098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.732079    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 01:13:40.742311 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.742287    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzk7m\" (UniqueName: \"kubernetes.io/projected/15c31a0b-130b-406d-b4c6-899372d9cec5-kube-api-access-dzk7m\") pod \"network-check-target-f7mpf\" (UID: \"15c31a0b-130b-406d-b4c6-899372d9cec5\") " pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:40.836392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.836367    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f5jnh\""
Sep 19 01:13:40.842256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.842243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-p58b7"
Sep 19 01:13:40.844316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.844302    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:40.854754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.854737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lthdr\""
Sep 19 01:13:40.863335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:40.863320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dbmjk"
Sep 19 01:13:41.056177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.056145    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"]
Sep 19 01:13:41.058492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.058477    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.061133 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.061104    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8w9zp\""
Sep 19 01:13:41.061246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.061160    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 19 01:13:41.061596 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.061581    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 19 01:13:41.061679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.061664    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 19 01:13:41.062262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.062247    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 19 01:13:41.094196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.094174    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"]
Sep 19 01:13:41.122576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.122551    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr82r\" (UniqueName: \"kubernetes.io/projected/04da697f-d8db-4b6d-8760-1ff7f8002494-kube-api-access-qr82r\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.122673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.122595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04da697f-d8db-4b6d-8760-1ff7f8002494-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.143581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.143500    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6594f4c75-tbqb8"]
Sep 19 01:13:41.145496 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.145477    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"]
Sep 19 01:13:41.145631 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.145612    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:13:41.147347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.147329    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:41.149218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.149199    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 19 01:13:41.149218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.149207    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j2fhq\""
Sep 19 01:13:41.149369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.149240    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 19 01:13:41.149545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.149531    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 19 01:13:41.150406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.150390    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-n7d67\""
Sep 19 01:13:41.167662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.167632    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"]
Sep 19 01:13:41.168383 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.168366    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-p58b7"]
Sep 19 01:13:41.170835 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.170813    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c9a1446_5387_4dcc_8ffd_61865b20b704.slice/crio-be7e14f59f77cfe24a3c3ed1cca68ef9def781458dd2101c97fd47af8094f241 WatchSource:0}: Error finding container be7e14f59f77cfe24a3c3ed1cca68ef9def781458dd2101c97fd47af8094f241: Status 404 returned error can't find the container with id be7e14f59f77cfe24a3c3ed1cca68ef9def781458dd2101c97fd47af8094f241
Sep 19 01:13:41.174016 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.173940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-tbqb8"]
Sep 19 01:13:41.191393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.191372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f7mpf"]
Sep 19 01:13:41.193773 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.193749    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c31a0b_130b_406d_b4c6_899372d9cec5.slice/crio-758ebef9f8a07c3de096e74781176b67f9bb886e88f021266bb07a287e6f02b2 WatchSource:0}: Error finding container 758ebef9f8a07c3de096e74781176b67f9bb886e88f021266bb07a287e6f02b2: Status 404 returned error can't find the container with id 758ebef9f8a07c3de096e74781176b67f9bb886e88f021266bb07a287e6f02b2
Sep 19 01:13:41.207286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.207268    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dbmjk"]
Sep 19 01:13:41.208907 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.208892    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65420911_0e63_4656_9460_51311cf8e4fb.slice/crio-ef7ae9efd087785b6bf18f9e4ad31144a4ccd6fd7faa8a4e906a953a4162e69d WatchSource:0}: Error finding container ef7ae9efd087785b6bf18f9e4ad31144a4ccd6fd7faa8a4e906a953a4162e69d: Status 404 returned error can't find the container with id ef7ae9efd087785b6bf18f9e4ad31144a4ccd6fd7faa8a4e906a953a4162e69d
Sep 19 01:13:41.214439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.214418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:41.222948 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.222910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr82r\" (UniqueName: \"kubernetes.io/projected/04da697f-d8db-4b6d-8760-1ff7f8002494-kube-api-access-qr82r\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.223031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.222967    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wvw\" (UniqueName: \"kubernetes.io/projected/4b052f94-972d-4848-ac7f-499dec0d58d3-kube-api-access-79wvw\") pod \"downloads-6594f4c75-tbqb8\" (UID: \"4b052f94-972d-4848-ac7f-499dec0d58d3\") " pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:13:41.223031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.222991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04da697f-d8db-4b6d-8760-1ff7f8002494-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.223031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.223020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dc22f166-c301-4a08-ace8-5d7e0a173d7d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8kbmm\" (UID: \"dc22f166-c301-4a08-ace8-5d7e0a173d7d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:41.225375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.225354    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/04da697f-d8db-4b6d-8760-1ff7f8002494-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.236118 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.236096    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr82r\" (UniqueName: \"kubernetes.io/projected/04da697f-d8db-4b6d-8760-1ff7f8002494-kube-api-access-qr82r\") pod \"managed-serviceaccount-addon-agent-7d5b894866-c4vjm\" (UID: \"04da697f-d8db-4b6d-8760-1ff7f8002494\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.241966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.241946    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"]
Sep 19 01:13:41.244347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.244332    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.251068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.251051    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 01:13:41.251389 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.251374    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5r66s\""
Sep 19 01:13:41.254150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.254134    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 01:13:41.254831 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.254815    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 01:13:41.259395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.259375    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 01:13:41.268000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.267981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"]
Sep 19 01:13:41.273675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.273655    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7mpf" event={"ID":"15c31a0b-130b-406d-b4c6-899372d9cec5","Type":"ContainerStarted","Data":"758ebef9f8a07c3de096e74781176b67f9bb886e88f021266bb07a287e6f02b2"}
Sep 19 01:13:41.274680 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.274659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p58b7" event={"ID":"0c9a1446-5387-4dcc-8ffd-61865b20b704","Type":"ContainerStarted","Data":"be7e14f59f77cfe24a3c3ed1cca68ef9def781458dd2101c97fd47af8094f241"}
Sep 19 01:13:41.275637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.275621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbmjk" event={"ID":"65420911-0e63-4656-9460-51311cf8e4fb","Type":"ContainerStarted","Data":"ef7ae9efd087785b6bf18f9e4ad31144a4ccd6fd7faa8a4e906a953a4162e69d"}
Sep 19 01:13:41.324301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324279    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ll8m\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-kube-api-access-5ll8m\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wvw\" (UniqueName: \"kubernetes.io/projected/4b052f94-972d-4848-ac7f-499dec0d58d3-kube-api-access-79wvw\") pod \"downloads-6594f4c75-tbqb8\" (UID: \"4b052f94-972d-4848-ac7f-499dec0d58d3\") " pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:13:41.324402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-installation-pull-secrets\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-trusted-ca\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-certificates\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-bound-sa-token\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324507    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-image-registry-private-configuration\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-tls\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-ca-trust-extracted\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.324620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.324596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dc22f166-c301-4a08-ace8-5d7e0a173d7d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8kbmm\" (UID: \"dc22f166-c301-4a08-ace8-5d7e0a173d7d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:41.326833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.326816    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/dc22f166-c301-4a08-ace8-5d7e0a173d7d-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-8kbmm\" (UID: \"dc22f166-c301-4a08-ace8-5d7e0a173d7d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:41.340559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.340539    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wvw\" (UniqueName: \"kubernetes.io/projected/4b052f94-972d-4848-ac7f-499dec0d58d3-kube-api-access-79wvw\") pod \"downloads-6594f4c75-tbqb8\" (UID: \"4b052f94-972d-4848-ac7f-499dec0d58d3\") " pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:13:41.355206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.355181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:41.376713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.376693    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425097    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-certificates\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-bound-sa-token\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-image-registry-private-configuration\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-tls\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-ca-trust-extracted\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ll8m\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-kube-api-access-5ll8m\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-installation-pull-secrets\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.425953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.425365    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-trusted-ca\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.426686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.426063    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-certificates\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.427113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.426738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-ca-trust-extracted\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.427461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.427408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-trusted-ca\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.428781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.428761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-installation-pull-secrets\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.428944 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.428912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-image-registry-private-configuration\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.429401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.429386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-registry-tls\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.435035 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.434995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-bound-sa-token\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.436158 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.436142    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ll8m\" (UniqueName: \"kubernetes.io/projected/cfb0d07c-0f84-4bfe-9ef0-6c7219974538-kube-api-access-5ll8m\") pod \"image-registry-69d5c4cdcd-wrgt9\" (UID: \"cfb0d07c-0f84-4bfe-9ef0-6c7219974538\") " pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.456249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.456229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:13:41.460457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.460434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:41.465146 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.465123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:41.552641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.552617    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:41.568418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.568389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:41.723567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.723474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm"]
Sep 19 01:13:41.730602 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.730572    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04da697f_d8db_4b6d_8760_1ff7f8002494.slice/crio-2287b6a3112db9975f648b86852f1ec5f3ba3edeb08d2eac4923f2de10f84106 WatchSource:0}: Error finding container 2287b6a3112db9975f648b86852f1ec5f3ba3edeb08d2eac4923f2de10f84106: Status 404 returned error can't find the container with id 2287b6a3112db9975f648b86852f1ec5f3ba3edeb08d2eac4923f2de10f84106
Sep 19 01:13:41.745320 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.745257    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6594f4c75-tbqb8"]
Sep 19 01:13:41.748121 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.748095    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b052f94_972d_4848_ac7f_499dec0d58d3.slice/crio-bd339c1ac226532ac6a3c7c3807571b777999d24ec5cfd7347a3ff9d4f375444 WatchSource:0}: Error finding container bd339c1ac226532ac6a3c7c3807571b777999d24ec5cfd7347a3ff9d4f375444: Status 404 returned error can't find the container with id bd339c1ac226532ac6a3c7c3807571b777999d24ec5cfd7347a3ff9d4f375444
Sep 19 01:13:41.751246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.751218    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"]
Sep 19 01:13:41.757740 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.757713    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc22f166_c301_4a08_ace8_5d7e0a173d7d.slice/crio-f55b6d3fe5832d5b9034932a6778e5c6ac43e79addd696b5766bab4a5160ab5a WatchSource:0}: Error finding container f55b6d3fe5832d5b9034932a6778e5c6ac43e79addd696b5766bab4a5160ab5a: Status 404 returned error can't find the container with id f55b6d3fe5832d5b9034932a6778e5c6ac43e79addd696b5766bab4a5160ab5a
Sep 19 01:13:41.830429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.829956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:41.833371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.833344    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cc9f15ae-63d7-48ee-ba3a-16f63932fa99-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-59vn6\" (UID: \"cc9f15ae-63d7-48ee-ba3a-16f63932fa99\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:41.852123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:41.851646    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"]
Sep 19 01:13:41.854408 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:41.854376    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb0d07c_0f84_4bfe_9ef0_6c7219974538.slice/crio-0cf9ba5c3888de82b7f92fbca625dafaa923e35f656ba46c17816926d23ca641 WatchSource:0}: Error finding container 0cf9ba5c3888de82b7f92fbca625dafaa923e35f656ba46c17816926d23ca641: Status 404 returned error can't find the container with id 0cf9ba5c3888de82b7f92fbca625dafaa923e35f656ba46c17816926d23ca641
Sep 19 01:13:42.052388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.052355    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2nstq\""
Sep 19 01:13:42.058788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.058701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"
Sep 19 01:13:42.292445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.292404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9" event={"ID":"cfb0d07c-0f84-4bfe-9ef0-6c7219974538","Type":"ContainerStarted","Data":"4b0a4093fcaad96ea93b4c8503430af0494ed838926179e60e867fb2b296b5b2"}
Sep 19 01:13:42.292609 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.292493    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9" event={"ID":"cfb0d07c-0f84-4bfe-9ef0-6c7219974538","Type":"ContainerStarted","Data":"0cf9ba5c3888de82b7f92fbca625dafaa923e35f656ba46c17816926d23ca641"}
Sep 19 01:13:42.292691 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.292657    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:13:42.294560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.294533    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm" event={"ID":"04da697f-d8db-4b6d-8760-1ff7f8002494","Type":"ContainerStarted","Data":"2287b6a3112db9975f648b86852f1ec5f3ba3edeb08d2eac4923f2de10f84106"}
Sep 19 01:13:42.296244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.296219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm" event={"ID":"dc22f166-c301-4a08-ace8-5d7e0a173d7d","Type":"ContainerStarted","Data":"f55b6d3fe5832d5b9034932a6778e5c6ac43e79addd696b5766bab4a5160ab5a"}
Sep 19 01:13:42.298372 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.298323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-tbqb8" event={"ID":"4b052f94-972d-4848-ac7f-499dec0d58d3","Type":"ContainerStarted","Data":"bd339c1ac226532ac6a3c7c3807571b777999d24ec5cfd7347a3ff9d4f375444"}
Sep 19 01:13:42.338295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.338234    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9" podStartSLOduration=1.338214219 podStartE2EDuration="1.338214219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:42.337079476 +0000 UTC m=+69.678527424" watchObservedRunningTime="2026-09-19 01:13:42.338214219 +0000 UTC m=+69.679662135"
Sep 19 01:13:42.608907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:42.608872    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-59vn6"]
Sep 19 01:13:43.310527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.310486    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6" event={"ID":"cc9f15ae-63d7-48ee-ba3a-16f63932fa99","Type":"ContainerStarted","Data":"aab1610fdd6522538a48afa5a7ca9a00b36c3fcb28ff549b006b7ac22ff1966c"}
Sep 19 01:13:43.315587 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.315534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbmjk" event={"ID":"65420911-0e63-4656-9460-51311cf8e4fb","Type":"ContainerStarted","Data":"fed54134bf536503f3cab42afdc5d9319fce4db036fff649e99fb1ea172055fe"}
Sep 19 01:13:43.315721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.315595    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dbmjk" event={"ID":"65420911-0e63-4656-9460-51311cf8e4fb","Type":"ContainerStarted","Data":"496b0964803dffcac61de812f36a76743afe5428411ef6fcfa003372199a5a67"}
Sep 19 01:13:43.365896 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.365656    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dbmjk" podStartSLOduration=67.229330259 podStartE2EDuration="1m8.365637883s" totalImagesPullingTime="1.136307624s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:43.363522566 +0000 UTC m=+70.704970512" watchObservedRunningTime="2026-09-19 01:13:43.365637883 +0000 UTC m=+70.707085807"
Sep 19 01:13:43.693091 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.692907    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:43.847762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:43.847667    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:44.037956 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:44.037851    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:45.422430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.422390    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:13:45.425473 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.425453    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.435109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.435088    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 19 01:13:45.435236 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.435163    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 19 01:13:45.435307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.435167    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 19 01:13:45.436173 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.436152    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 19 01:13:45.436273 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.436186    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 19 01:13:45.436273 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.436219    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-22f44\""
Sep 19 01:13:45.449067 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.449047    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:13:45.559498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559464    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.559622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.559622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.559622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.559622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bs8g\" (UniqueName: \"kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.559786 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.559688    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660572    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660600    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.660700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.660623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bs8g\" (UniqueName: \"kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.661631 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.661583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.661745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.661698    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.661804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.661749    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.664372 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.664185    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.665704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.665681    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.685082 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.685025    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bs8g\" (UniqueName: \"kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g\") pod \"console-654448cfb5-vhf44\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") " pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.737911 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.737883    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:13:45.967442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:45.967342    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:46.058295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:46.058253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:48.927574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:48.927543    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:13:48.932939 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:13:48.932894    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod116f24e3_cf19_48b4_9d07_332766487aa9.slice/crio-900a35cc0f4b65a18da65a20defc0bee83048c6523d8c552cd88630aeb663e01 WatchSource:0}: Error finding container 900a35cc0f4b65a18da65a20defc0bee83048c6523d8c552cd88630aeb663e01: Status 404 returned error can't find the container with id 900a35cc0f4b65a18da65a20defc0bee83048c6523d8c552cd88630aeb663e01
Sep 19 01:13:49.342803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.342767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f7mpf" event={"ID":"15c31a0b-130b-406d-b4c6-899372d9cec5","Type":"ContainerStarted","Data":"b1ccc6453085f9e3c7b542f3a5117a41954b6780d226ab9f3a81529732e50eae"}
Sep 19 01:13:49.343015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.342899    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:13:49.344565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.344531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-p58b7" event={"ID":"0c9a1446-5387-4dcc-8ffd-61865b20b704","Type":"ContainerStarted","Data":"fd898b407613a95c93fa29b42f8024a69d52d907678699e4d6a70846d5b5b40e"}
Sep 19 01:13:49.346184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.346156    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm" event={"ID":"04da697f-d8db-4b6d-8760-1ff7f8002494","Type":"ContainerStarted","Data":"9d68543ef5d82d0b989d8a5b14daf9ddd1ff8c7f783bdb3861cd352b80a5eec5"}
Sep 19 01:13:49.347869 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.347843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm" event={"ID":"dc22f166-c301-4a08-ace8-5d7e0a173d7d","Type":"ContainerStarted","Data":"39dbc2bf47bab995d1e9393c9791406d273650ae5d3013686fb995c426071ec4"}
Sep 19 01:13:49.348004 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.347943    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:49.349574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.349555    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6" event={"ID":"cc9f15ae-63d7-48ee-ba3a-16f63932fa99","Type":"ContainerStarted","Data":"ae41190327f7e03f9d4604bc41b3765862310699b28c05438eb50e43abe28a66"}
Sep 19 01:13:49.351146 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.351118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654448cfb5-vhf44" event={"ID":"116f24e3-cf19-48b4-9d07-332766487aa9","Type":"ContainerStarted","Data":"900a35cc0f4b65a18da65a20defc0bee83048c6523d8c552cd88630aeb663e01"}
Sep 19 01:13:49.353460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.353439    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm"
Sep 19 01:13:49.437899 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.437848    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f7mpf" podStartSLOduration=67.004127519 podStartE2EDuration="1m14.437834888s" totalImagesPullingTime="7.433707369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:49.389497572 +0000 UTC m=+76.730945496" watchObservedRunningTime="2026-09-19 01:13:49.437834888 +0000 UTC m=+76.779282811"
Sep 19 01:13:49.463836 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.462057    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-p58b7" podStartSLOduration=66.995254856 podStartE2EDuration="1m14.462039524s" totalImagesPullingTime="7.466784668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:49.461597929 +0000 UTC m=+76.803045854" watchObservedRunningTime="2026-09-19 01:13:49.462039524 +0000 UTC m=+76.803487449"
Sep 19 01:13:49.463836 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.463686    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-59vn6" podStartSLOduration=34.467960062 podStartE2EDuration="40.463676579s" totalImagesPullingTime="5.995716517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:49.439384406 +0000 UTC m=+76.780832333" watchObservedRunningTime="2026-09-19 01:13:49.463676579 +0000 UTC m=+76.805124503"
Sep 19 01:13:49.498251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.497813    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d5b894866-c4vjm" podStartSLOduration=1.598626361 podStartE2EDuration="8.49779433s" totalImagesPullingTime="6.899167969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:49.495824779 +0000 UTC m=+76.837272697" watchObservedRunningTime="2026-09-19 01:13:49.49779433 +0000 UTC m=+76.839242255"
Sep 19 01:13:49.667996 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.667830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:49.767644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:49.767553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:50.148424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:50.148372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:50.226293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:50.226255    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:50.314766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:50.314685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:51.187176 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:51.187127    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:53.973144 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:53.973103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:54.380592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.380549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:54.502263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.502221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:54.689857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.689766    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:54.760815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.760733    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:54.921517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.921460    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-8kbmm" podStartSLOduration=7.06509257 podStartE2EDuration="13.921441863s" totalImagesPullingTime="6.856349293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:13:49.531584991 +0000 UTC m=+76.873032914" watchObservedRunningTime="2026-09-19 01:13:54.921441863 +0000 UTC m=+82.262889789"
Sep 19 01:13:54.922656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.922634    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:13:54.926118 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.926095    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:54.934183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.934123    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 19 01:13:54.941645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:54.941593    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:13:55.052721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052689    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.052721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.053201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052755    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.053201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.053201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw46x\" (UniqueName: \"kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.053201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.053201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.052937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153327    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153364    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw46x\" (UniqueName: \"kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153419    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.153524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.153507    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.154376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.154254    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.154376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.154365    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.154559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.154480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.154610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.154583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.156250 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.156228    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.156457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.156439    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.161940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.161899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw46x\" (UniqueName: \"kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x\") pod \"console-78c7cf5554-8krmr\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") " pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:55.237529 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:55.237456    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:13:56.515681 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.515644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:56.650554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.650513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:56.759288 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.759216    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:56.763755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.763716    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mw7c7"]
Sep 19 01:13:56.776812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.776745    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.780757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.780730    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 01:13:56.781822 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.781796    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hn4x7\""
Sep 19 01:13:56.782037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.782023    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 01:13:56.782215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.782200    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 01:13:56.782340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.782325    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 01:13:56.782398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.782373    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 01:13:56.782550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.782535    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-root\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-metrics-client-ca\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869904    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869963    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8284k\" (UniqueName: \"kubernetes.io/projected/10b62535-3b55-45db-85a8-0d6c275f909f-kube-api-access-8284k\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.869996    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-sys\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.870024    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.870053    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-textfile\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.870246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.870086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-wtmp\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.899087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.899022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:56.970465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970438    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-root\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-metrics-client-ca\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970509    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970568    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8284k\" (UniqueName: \"kubernetes.io/projected/10b62535-3b55-45db-85a8-0d6c275f909f-kube-api-access-8284k\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-sys\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970618    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-textfile\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.970710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970677    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-wtmp\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970873    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-wtmp\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.970945    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-root\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.971262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b62535-3b55-45db-85a8-0d6c275f909f-sys\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.971551    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-accelerators-collector-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:56.971667    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:56.971720    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls podName:10b62535-3b55-45db-85a8-0d6c275f909f nodeName:}" failed. No retries permitted until 2026-09-19 01:13:57.471704136 +0000 UTC m=+84.813152052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls") pod "node-exporter-mw7c7" (UID: "10b62535-3b55-45db-85a8-0d6c275f909f") : secret "node-exporter-tls" not found
Sep 19 01:13:56.972155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.971858    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-textfile\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.972529 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.972329    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b62535-3b55-45db-85a8-0d6c275f909f-metrics-client-ca\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.973873 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.973853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.992228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.992199    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8284k\" (UniqueName: \"kubernetes.io/projected/10b62535-3b55-45db-85a8-0d6c275f909f-kube-api-access-8284k\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:56.997266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:56.997191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.105226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.105136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.307124 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.307090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.406491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.406408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.474989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.474960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:57.478181 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.478119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/10b62535-3b55-45db-85a8-0d6c275f909f-node-exporter-tls\") pod \"node-exporter-mw7c7\" (UID: \"10b62535-3b55-45db-85a8-0d6c275f909f\") " pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:57.564857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.564815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.689443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.689378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mw7c7"
Sep 19 01:13:57.837807 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.837770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.960094 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.960019    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:13:57.965817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.965795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:57.969652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.969622    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:57.971318 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.971297    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.971791    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.971979    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.971980    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972096    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972099    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xzmpp\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972200    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972206    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 01:13:57.972298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972229    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 01:13:57.972718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.972568    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 01:13:57.998388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:57.998368    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:13:58.078439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078450    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5r5d\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078506    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078676    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.078818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.079104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.078866    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.179871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179902    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5r5d\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.179996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.180022    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.180206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.180114    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.181079 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:58.181055    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 19 01:13:58.181185 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:58.181133    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls podName:4163bfd2-0687-4fff-a858-d316d30e0897 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:58.681101862 +0000 UTC m=+86.022549776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897") : secret "alertmanager-main-tls" not found
Sep 19 01:13:58.181776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.181746    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.182187 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.182120    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.184606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.184575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.184606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.184586    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.185128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.185066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.185128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.185066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.185299 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.185275    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.185843 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.185818    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.186177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.186153    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.186590 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.186561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.198136 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.198113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5r5d\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.685153 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.685111    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:58.685622 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:58.685278    2567 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 19 01:13:58.685622 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:13:58.685354    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls podName:4163bfd2-0687-4fff-a858-d316d30e0897 nodeName:}" failed. No retries permitted until 2026-09-19 01:13:59.68533877 +0000 UTC m=+87.026786672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897") : secret "alertmanager-main-tls" not found
Sep 19 01:13:58.876545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:58.876503    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:59.184256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.184216    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:59.409074 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.409034    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:59.608605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.608568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:13:59.694653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.694615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:59.697422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.697398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:59.777999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.777964    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:13:59.964337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:13:59.964253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:00.088196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:00.088136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:00.167593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:00.167559    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:00.299993 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:00.299959    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:00.563650 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:00.563574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:00.940958 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:00.940930    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b62535_3b55_45db_85a8_0d6c275f909f.slice/crio-cdf4eaffcdf92ee37dfa3b0180f040e411dd57b1e9283477ca583ad9bb8fd0bb WatchSource:0}: Error finding container cdf4eaffcdf92ee37dfa3b0180f040e411dd57b1e9283477ca583ad9bb8fd0bb: Status 404 returned error can't find the container with id cdf4eaffcdf92ee37dfa3b0180f040e411dd57b1e9283477ca583ad9bb8fd0bb
Sep 19 01:14:01.255951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.255812    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:14:01.258775 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:01.258737    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8257bec_a892_4808_a369_87c5ca9e0f4b.slice/crio-f5c35cd1f9b4ca6478b32a35b12cbb12f69250854401353108633f1c825abf10 WatchSource:0}: Error finding container f5c35cd1f9b4ca6478b32a35b12cbb12f69250854401353108633f1c825abf10: Status 404 returned error can't find the container with id f5c35cd1f9b4ca6478b32a35b12cbb12f69250854401353108633f1c825abf10
Sep 19 01:14:01.273803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.273717    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:14:01.279592 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:01.279557    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4163bfd2_0687_4fff_a858_d316d30e0897.slice/crio-b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a WatchSource:0}: Error finding container b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a: Status 404 returned error can't find the container with id b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a
Sep 19 01:14:01.409757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.409596    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c7cf5554-8krmr" event={"ID":"e8257bec-a892-4808-a369-87c5ca9e0f4b","Type":"ContainerStarted","Data":"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"}
Sep 19 01:14:01.409757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.409654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c7cf5554-8krmr" event={"ID":"e8257bec-a892-4808-a369-87c5ca9e0f4b","Type":"ContainerStarted","Data":"f5c35cd1f9b4ca6478b32a35b12cbb12f69250854401353108633f1c825abf10"}
Sep 19 01:14:01.411994 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.411796    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a"}
Sep 19 01:14:01.414245 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.414042    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mw7c7" event={"ID":"10b62535-3b55-45db-85a8-0d6c275f909f","Type":"ContainerStarted","Data":"cdf4eaffcdf92ee37dfa3b0180f040e411dd57b1e9283477ca583ad9bb8fd0bb"}
Sep 19 01:14:01.417536 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.417485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6594f4c75-tbqb8" event={"ID":"4b052f94-972d-4848-ac7f-499dec0d58d3","Type":"ContainerStarted","Data":"75be6c3fbf397e94e5956d2fd52b140deef5df058d2e952aa0da3398adef6417"}
Sep 19 01:14:01.418905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.418111    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:14:01.420459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.420437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654448cfb5-vhf44" event={"ID":"116f24e3-cf19-48b4-9d07-332766487aa9","Type":"ContainerStarted","Data":"cbf2bf1ef08092aebcdc00eb72a7b58787810c6223ea1b30ea23bdfd6d20952b"}
Sep 19 01:14:01.425493 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.425444    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6594f4c75-tbqb8"
Sep 19 01:14:01.436578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.436505    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78c7cf5554-8krmr" podStartSLOduration=7.436489023 podStartE2EDuration="7.436489023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:01.434290433 +0000 UTC m=+88.775738357" watchObservedRunningTime="2026-09-19 01:14:01.436489023 +0000 UTC m=+88.777936949"
Sep 19 01:14:01.506744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.506634    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6594f4c75-tbqb8" podStartSLOduration=1.259891233 podStartE2EDuration="20.506241867s" totalImagesPullingTime="19.246350634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:01.504654331 +0000 UTC m=+88.846102256" watchObservedRunningTime="2026-09-19 01:14:01.506241867 +0000 UTC m=+88.847689794"
Sep 19 01:14:01.507263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.507219    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-654448cfb5-vhf44" podStartSLOduration=4.501165128 podStartE2EDuration="16.507206333s" totalImagesPullingTime="12.006041205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:01.471085358 +0000 UTC m=+88.812533282" watchObservedRunningTime="2026-09-19 01:14:01.507206333 +0000 UTC m=+88.848654261"
Sep 19 01:14:01.559310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.558511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:01.644494 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.644458    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:01.749132 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.749097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:01.779525 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:01.779497    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:14:02.025104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.025035    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-857d5fd69-cgpnq"]
Sep 19 01:14:02.052534 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.052436    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-857d5fd69-cgpnq"]
Sep 19 01:14:02.052805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.052572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.055355    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.055687    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.055796    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.055903    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w7dl7\""
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.056116    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 19 01:14:02.056442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.056262    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 19 01:14:02.065250 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.065205    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 19 01:14:02.216532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.216702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.216702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.216702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-serving-certs-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.216702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216664    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.216702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-metrics-client-ca\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.217010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216747    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-federate-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.217010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.216763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsg4c\" (UniqueName: \"kubernetes.io/projected/a467b25c-0417-4448-867e-608ea0ffeb92-kube-api-access-vsg4c\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.317991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-federate-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318045    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsg4c\" (UniqueName: \"kubernetes.io/projected/a467b25c-0417-4448-867e-608ea0ffeb92-kube-api-access-vsg4c\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318141    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318165    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-serving-certs-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318248    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.318302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.318289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-metrics-client-ca\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.319319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.319008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-metrics-client-ca\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.319726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.319687    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-trusted-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.320565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.320503    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a467b25c-0417-4448-867e-608ea0ffeb92-serving-certs-ca-bundle\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.321636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.321604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-federate-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.322234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.322194    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-telemeter-client-tls\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.322234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.322206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.324763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.324718    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a467b25c-0417-4448-867e-608ea0ffeb92-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.328837 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.328795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsg4c\" (UniqueName: \"kubernetes.io/projected/a467b25c-0417-4448-867e-608ea0ffeb92-kube-api-access-vsg4c\") pod \"telemeter-client-857d5fd69-cgpnq\" (UID: \"a467b25c-0417-4448-867e-608ea0ffeb92\") " pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:02.367900 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:02.367692    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq"
Sep 19 01:14:03.218432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.218400    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-857d5fd69-cgpnq"]
Sep 19 01:14:03.219829 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:03.219795    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda467b25c_0417_4448_867e_608ea0ffeb92.slice/crio-e49ff86229f91e020d08253a1ec524db05e0cfefd4cb0605791443286d0e128e WatchSource:0}: Error finding container e49ff86229f91e020d08253a1ec524db05e0cfefd4cb0605791443286d0e128e: Status 404 returned error can't find the container with id e49ff86229f91e020d08253a1ec524db05e0cfefd4cb0605791443286d0e128e
Sep 19 01:14:03.320614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.320587    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69d5c4cdcd-wrgt9"
Sep 19 01:14:03.330725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.330695    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:03.338487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.338462    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:14:03.353978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.353953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.357272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.357249    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 01:14:03.358015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.357793    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ea62dkof4iugc\""
Sep 19 01:14:03.358015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.357804    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6lchc\""
Sep 19 01:14:03.358015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.357948    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 01:14:03.358563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.358539    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 01:14:03.358686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.358663    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 01:14:03.358901 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.358880    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 01:14:03.359043 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359020    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 01:14:03.359134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359100    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 01:14:03.359282 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.358884    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 01:14:03.359343 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359289    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 01:14:03.359490 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359463    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 01:14:03.359741 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359587    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 01:14:03.359741 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359657    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 01:14:03.359741 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.359697    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 01:14:03.363643 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.363621    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 01:14:03.366494 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.366472    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 01:14:03.393275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.393247    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:14:03.432619 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.432591    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="9c2a3fca56a202563b1b055327b3829d0f11011b0877ca0eaf1b37ab66a2d3f7" exitCode=0
Sep 19 01:14:03.432952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.432893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"9c2a3fca56a202563b1b055327b3829d0f11011b0877ca0eaf1b37ab66a2d3f7"}
Sep 19 01:14:03.435390 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.435370    2567 generic.go:356] "Generic (PLEG): container finished" podID="10b62535-3b55-45db-85a8-0d6c275f909f" containerID="9c44fa95db2bfc18deaad8567bb74977ab6cf9ca66d53fc9aa0accb1d2d80bdb" exitCode=0
Sep 19 01:14:03.435488 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.435464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mw7c7" event={"ID":"10b62535-3b55-45db-85a8-0d6c275f909f","Type":"ContainerDied","Data":"9c44fa95db2bfc18deaad8567bb74977ab6cf9ca66d53fc9aa0accb1d2d80bdb"}
Sep 19 01:14:03.437909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.437860    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq" event={"ID":"a467b25c-0417-4448-867e-608ea0ffeb92","Type":"ContainerStarted","Data":"e49ff86229f91e020d08253a1ec524db05e0cfefd4cb0605791443286d0e128e"}
Sep 19 01:14:03.527795 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.527766    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528048    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528209 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528187    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528325 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528307    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6b6b\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528587 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528671 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528606    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528671 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528698    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528750    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528805    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.528960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.529150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.528982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.529150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.529021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.529150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.529069    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.529150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.529100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.529363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.529339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629735    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629777    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.629848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629826    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629859    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629885    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.629998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630025    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6b6b\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630086    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630153    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630152    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630203    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630232    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630295    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.630391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.630382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.632243 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.632214    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.633042 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.632899    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.633586    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.633864    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.634106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.634505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.634521    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.635045    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.635050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.635395    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.635559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.635515    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.636297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.635868    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.637110 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.637011    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.639351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.639306    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.639351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.639328    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.639492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.639331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.639492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.639409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.639793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.639773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.655318 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.655296    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6b6b\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b\") pod \"prometheus-k8s-0\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.666147 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.666124    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:03.670471 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.670442    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:03.787840 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.787805    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:03.995736 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:03.995704    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:14:03.998315 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:03.998273    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ec986d_4e57_4506_8d93_bc675c2f9c87.slice/crio-4e77d8efe2e3d2f93f75395390e2744f1df931315418272d7751ecc3bd038c57 WatchSource:0}: Error finding container 4e77d8efe2e3d2f93f75395390e2744f1df931315418272d7751ecc3bd038c57: Status 404 returned error can't find the container with id 4e77d8efe2e3d2f93f75395390e2744f1df931315418272d7751ecc3bd038c57
Sep 19 01:14:04.160882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.160752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:04.332118 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.332087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:04.425018 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.424984    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:04.444744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.444704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mw7c7" event={"ID":"10b62535-3b55-45db-85a8-0d6c275f909f","Type":"ContainerStarted","Data":"c99581bad3fcb3b7df52906d394f00905d51aee94cafbdc98ba8b9d798469af0"}
Sep 19 01:14:04.444909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.444764    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mw7c7" event={"ID":"10b62535-3b55-45db-85a8-0d6c275f909f","Type":"ContainerStarted","Data":"bdd01dc593fbdbd6019bf4cdcff7665b3ebd03ac85fb42fdf6196010e18e79f4"}
Sep 19 01:14:04.448376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.447249    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55" exitCode=0
Sep 19 01:14:04.448376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.447323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"}
Sep 19 01:14:04.448376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.447391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"4e77d8efe2e3d2f93f75395390e2744f1df931315418272d7751ecc3bd038c57"}
Sep 19 01:14:04.471868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:04.471654    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mw7c7" podStartSLOduration=6.414488588 podStartE2EDuration="8.471634164s" totalImagesPullingTime="1.983840374s" totalInitContainerRuntime="73.305202ms" isStatefulPod=true podCreationTimestamp="2026-09-19 01:13:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:04.468867635 +0000 UTC m=+91.810315559" watchObservedRunningTime="2026-09-19 01:14:04.471634164 +0000 UTC m=+91.813082093"
Sep 19 01:14:05.238634 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:05.238501    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:05.238634 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:05.238613    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:05.244850 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:05.244564    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:05.457655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:05.457578    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:05.738904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:05.738869    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:14:06.024160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:06.023948    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:06.129279 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:06.129207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:07.473730 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.473651    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"d7cd8b3c3a4abd9a67b11aa983b1b4874dafb8412e0fda33a64de83651e89fcc"}
Sep 19 01:14:07.474321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.474296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"809bed3b90189524b3bb651c4b45247fb9d71f6462b8f1dccbdd8877c7576db3"}
Sep 19 01:14:07.474508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.474476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"ec345de85f344ac83890e75ac5cedf4f8f8e310e1c8a159e572ee4b35536c5cf"}
Sep 19 01:14:07.474618 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.474524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"c2c0fa901d30807ef9454225277d5618926172aa4b664a762f8b725b241c6bab"}
Sep 19 01:14:07.474618 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.474558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"3164b1d367edf051b5c788febef7450643efc0ca7e02222dbfa7e5b54e0759c8"}
Sep 19 01:14:07.477773 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.477744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq" event={"ID":"a467b25c-0417-4448-867e-608ea0ffeb92","Type":"ContainerStarted","Data":"3f999fa445105a3bcb62cb68cc94de7b325a1361c86be1eb84add02819454fc3"}
Sep 19 01:14:07.477908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.477794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq" event={"ID":"a467b25c-0417-4448-867e-608ea0ffeb92","Type":"ContainerStarted","Data":"2d2826abf46aa55a7844a35f6a0e3c54746b72c9fbe6a89dfef24a717fa4703d"}
Sep 19 01:14:07.477908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.477842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq" event={"ID":"a467b25c-0417-4448-867e-608ea0ffeb92","Type":"ContainerStarted","Data":"ff862f8561b175606f31894918278eaf6154fce83ccd722a6334c07ce2df1363"}
Sep 19 01:14:07.596236 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.596200    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:07.707222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.707130    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:07.823940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.823888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:07.940873 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:07.940835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:08.398960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:08.398869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:08.498670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:08.498596    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:09.051518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.051465    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-857d5fd69-cgpnq" podStartSLOduration=3.937365481 podStartE2EDuration="7.051442952s" totalImagesPullingTime="3.114077471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:14:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:07.538648149 +0000 UTC m=+94.880096074" watchObservedRunningTime="2026-09-19 01:14:09.051442952 +0000 UTC m=+96.392890879"
Sep 19 01:14:09.052071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.052047    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:14:09.075645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.075596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.090301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.090268    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:14:09.185072 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185039    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185081    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185099    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185257    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqr9z\" (UniqueName: \"kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.185344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.185335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.254530 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.254500    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:09.286227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqr9z\" (UniqueName: \"kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286269    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286335    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286360    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286476    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.286555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.286518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.287115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.287061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.287115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.287061    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.287599 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.287570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.287599 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.287588    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.289319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.289293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.289502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.289474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.296116 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.296092    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqr9z\" (UniqueName: \"kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z\") pod \"console-5c8dc855c9-vjgzf\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") " pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.355031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.354978    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:09.388884 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.388861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:09.980180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:09.980132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:14:09.982569 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:14:09.982539    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193f4dab_ffe1_4b11_a785_866dfcccec23.slice/crio-fac1feab10aaeddeac9418d3199171f124fae902503b07f7aaec8fb66e5ada5b WatchSource:0}: Error finding container fac1feab10aaeddeac9418d3199171f124fae902503b07f7aaec8fb66e5ada5b: Status 404 returned error can't find the container with id fac1feab10aaeddeac9418d3199171f124fae902503b07f7aaec8fb66e5ada5b
Sep 19 01:14:10.494362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.494326    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerStarted","Data":"2a8d864a4bde7d5ac3fead6e5995d2fc7c74993a22fa9fde20cc74bf283501fa"}
Sep 19 01:14:10.496645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.496616    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"}
Sep 19 01:14:10.496777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.496681    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"}
Sep 19 01:14:10.498083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.498063    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dc855c9-vjgzf" event={"ID":"193f4dab-ffe1-4b11-a785-866dfcccec23","Type":"ContainerStarted","Data":"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"}
Sep 19 01:14:10.498308 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.498096    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dc855c9-vjgzf" event={"ID":"193f4dab-ffe1-4b11-a785-866dfcccec23","Type":"ContainerStarted","Data":"fac1feab10aaeddeac9418d3199171f124fae902503b07f7aaec8fb66e5ada5b"}
Sep 19 01:14:10.627717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.627668    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.461488246 podStartE2EDuration="13.627649362s" totalImagesPullingTime="7.14973031s" totalInitContainerRuntime="16.430806ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:13:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:10.567129557 +0000 UTC m=+97.908577481" watchObservedRunningTime="2026-09-19 01:14:10.627649362 +0000 UTC m=+97.969097286"
Sep 19 01:14:10.628877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:10.628828    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c8dc855c9-vjgzf" podStartSLOduration=1.6288104730000001 podStartE2EDuration="1.628810473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:10.626972698 +0000 UTC m=+97.968420620" watchObservedRunningTime="2026-09-19 01:14:10.628810473 +0000 UTC m=+97.970258397"
Sep 19 01:14:12.513607 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:12.513580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"}
Sep 19 01:14:13.521329 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:13.521297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"}
Sep 19 01:14:13.521806 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:13.521360    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"}
Sep 19 01:14:13.521806 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:13.521386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerStarted","Data":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"}
Sep 19 01:14:13.555943 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:13.555881    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.966908226 podStartE2EDuration="10.55586411s" totalImagesPullingTime="7.564726389s" totalInitContainerRuntime="24.229495ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:14:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:14:13.554312418 +0000 UTC m=+100.895760366" watchObservedRunningTime="2026-09-19 01:14:13.55586411 +0000 UTC m=+100.897312033"
Sep 19 01:14:13.667086 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:13.667058    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:14:19.389053 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:19.389019    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:19.389518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:19.389070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:19.393909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:19.393889    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:19.553339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:19.553310    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:14:19.721519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:19.721442    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:14:20.210029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:20.209999    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:20.359436 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:20.359408    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f7mpf"
Sep 19 01:14:20.396602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:20.396568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:22.827226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:22.827183    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:22.920471 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:22.920445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:14:28.461939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.461872    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-654448cfb5-vhf44" podUID="116f24e3-cf19-48b4-9d07-332766487aa9" containerName="console" containerID="cri-o://cbf2bf1ef08092aebcdc00eb72a7b58787810c6223ea1b30ea23bdfd6d20952b" gracePeriod=15
Sep 19 01:14:28.586384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.586358    2567 generic.go:356] "Generic (PLEG): container finished" podID="116f24e3-cf19-48b4-9d07-332766487aa9" containerID="cbf2bf1ef08092aebcdc00eb72a7b58787810c6223ea1b30ea23bdfd6d20952b" exitCode=0
Sep 19 01:14:28.586502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.586426    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654448cfb5-vhf44" event={"ID":"116f24e3-cf19-48b4-9d07-332766487aa9","Type":"ContainerDied","Data":"cbf2bf1ef08092aebcdc00eb72a7b58787810c6223ea1b30ea23bdfd6d20952b"}
Sep 19 01:14:28.745065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.744962    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:14:28.852699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852672    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.852857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852749    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bs8g\" (UniqueName: \"kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.852857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852790    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.852857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852815    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.853052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852867    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.853052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.852893    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config\") pod \"116f24e3-cf19-48b4-9d07-332766487aa9\" (UID: \"116f24e3-cf19-48b4-9d07-332766487aa9\") "
Sep 19 01:14:28.853142 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.853097    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:28.853195 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.853182    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-oauth-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:28.853249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.853230    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config" (OuterVolumeSpecName: "console-config") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:28.853311 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.853264    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca" (OuterVolumeSpecName: "service-ca") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:28.855169 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.855147    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:14:28.855283 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.855200    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g" (OuterVolumeSpecName: "kube-api-access-6bs8g") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "kube-api-access-6bs8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:14:28.855283 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.855215    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "116f24e3-cf19-48b4-9d07-332766487aa9" (UID: "116f24e3-cf19-48b4-9d07-332766487aa9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:14:28.954018 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.953997    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-console-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:28.954018 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.954018    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:28.954163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.954028    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/116f24e3-cf19-48b4-9d07-332766487aa9-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:28.954163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.954036    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/116f24e3-cf19-48b4-9d07-332766487aa9-console-oauth-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:28.954163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:28.954044    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bs8g\" (UniqueName: \"kubernetes.io/projected/116f24e3-cf19-48b4-9d07-332766487aa9-kube-api-access-6bs8g\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:29.591459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:29.591426    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-654448cfb5-vhf44"
Sep 19 01:14:29.591459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:29.591443    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-654448cfb5-vhf44" event={"ID":"116f24e3-cf19-48b4-9d07-332766487aa9","Type":"ContainerDied","Data":"900a35cc0f4b65a18da65a20defc0bee83048c6523d8c552cd88630aeb663e01"}
Sep 19 01:14:29.591935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:29.591529    2567 scope.go:117] "RemoveContainer" containerID="cbf2bf1ef08092aebcdc00eb72a7b58787810c6223ea1b30ea23bdfd6d20952b"
Sep 19 01:14:29.624644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:29.624619    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:14:29.633415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:29.633395    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-654448cfb5-vhf44"]
Sep 19 01:14:30.920328 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:30.920299    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="116f24e3-cf19-48b4-9d07-332766487aa9" path="/var/lib/kubelet/pods/116f24e3-cf19-48b4-9d07-332766487aa9/volumes"
Sep 19 01:14:44.739792 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:44.739737    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78c7cf5554-8krmr" podUID="e8257bec-a892-4808-a369-87c5ca9e0f4b" containerName="console" containerID="cri-o://8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec" gracePeriod=15
Sep 19 01:14:45.032535 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.032507    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:45.076878 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.076856    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kw46x\" (UniqueName: \"kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.076892    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.076950    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.076975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077022    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077050    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077115    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert\") pod \"e8257bec-a892-4808-a369-87c5ca9e0f4b\" (UID: \"e8257bec-a892-4808-a369-87c5ca9e0f4b\") "
Sep 19 01:14:45.077384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077359    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:45.077452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077428    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca" (OuterVolumeSpecName: "service-ca") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:45.077502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077462    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config" (OuterVolumeSpecName: "console-config") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:45.077548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077501    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:14:45.077668 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077649    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.077726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077669    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.077726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077678    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-oauth-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.077726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.077687    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e8257bec-a892-4808-a369-87c5ca9e0f4b-trusted-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.079212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.079188    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:14:45.079542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.079513    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x" (OuterVolumeSpecName: "kube-api-access-kw46x") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "kube-api-access-kw46x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:14:45.079542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.079516    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e8257bec-a892-4808-a369-87c5ca9e0f4b" (UID: "e8257bec-a892-4808-a369-87c5ca9e0f4b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:14:45.178271 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.178245    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.178271 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.178268    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kw46x\" (UniqueName: \"kubernetes.io/projected/e8257bec-a892-4808-a369-87c5ca9e0f4b-kube-api-access-kw46x\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.178408 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.178281    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e8257bec-a892-4808-a369-87c5ca9e0f4b-console-oauth-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:14:45.658393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.658358    2567 generic.go:356] "Generic (PLEG): container finished" podID="e8257bec-a892-4808-a369-87c5ca9e0f4b" containerID="8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec" exitCode=0
Sep 19 01:14:45.658589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.658405    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78c7cf5554-8krmr"
Sep 19 01:14:45.658589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.658437    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c7cf5554-8krmr" event={"ID":"e8257bec-a892-4808-a369-87c5ca9e0f4b","Type":"ContainerDied","Data":"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"}
Sep 19 01:14:45.658589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.658490    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78c7cf5554-8krmr" event={"ID":"e8257bec-a892-4808-a369-87c5ca9e0f4b","Type":"ContainerDied","Data":"f5c35cd1f9b4ca6478b32a35b12cbb12f69250854401353108633f1c825abf10"}
Sep 19 01:14:45.658589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.658510    2567 scope.go:117] "RemoveContainer" containerID="8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"
Sep 19 01:14:45.667099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.667080    2567 scope.go:117] "RemoveContainer" containerID="8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"
Sep 19 01:14:45.667379 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:14:45.667357    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec\": container with ID starting with 8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec not found: ID does not exist" containerID="8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"
Sep 19 01:14:45.667453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.667391    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec"} err="failed to get container status \"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec\": rpc error: code = NotFound desc = could not find container \"8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec\": container with ID starting with 8b08f0bcd87468c021b0a02c729c915456229aa032e9a9957edee2315dab93ec not found: ID does not exist"
Sep 19 01:14:45.680294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.680272    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:14:45.684134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:45.684115    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78c7cf5554-8krmr"]
Sep 19 01:14:46.919653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:46.919617    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8257bec-a892-4808-a369-87c5ca9e0f4b" path="/var/lib/kubelet/pods/e8257bec-a892-4808-a369-87c5ca9e0f4b/volumes"
Sep 19 01:14:51.760610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:14:51.760556    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:03.666614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:03.666581    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:03.686593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:03.686565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:03.751897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:03.751868    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:13.122112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:13.122078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:13.197817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:13.197789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:15.060133 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:15.060095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:15.136766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:15.136719    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:15.199348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:15.199320    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:15.790850 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:15.790812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:15.852568 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:15.852537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:17.554026 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.553872    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554218    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="alertmanager" containerID="cri-o://3164b1d367edf051b5c788febef7450643efc0ca7e02222dbfa7e5b54e0759c8" gracePeriod=120
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554281    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-web" containerID="cri-o://ec345de85f344ac83890e75ac5cedf4f8f8e310e1c8a159e572ee4b35536c5cf" gracePeriod=120
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554307    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="config-reloader" containerID="cri-o://c2c0fa901d30807ef9454225277d5618926172aa4b664a762f8b725b241c6bab" gracePeriod=120
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554293    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy" containerID="cri-o://809bed3b90189524b3bb651c4b45247fb9d71f6462b8f1dccbdd8877c7576db3" gracePeriod=120
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554274    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-metric" containerID="cri-o://d7cd8b3c3a4abd9a67b11aa983b1b4874dafb8412e0fda33a64de83651e89fcc" gracePeriod=120
Sep 19 01:15:17.554419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.554334    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="prom-label-proxy" containerID="cri-o://2a8d864a4bde7d5ac3fead6e5995d2fc7c74993a22fa9fde20cc74bf283501fa" gracePeriod=120
Sep 19 01:15:17.793633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793600    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="2a8d864a4bde7d5ac3fead6e5995d2fc7c74993a22fa9fde20cc74bf283501fa" exitCode=0
Sep 19 01:15:17.793633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793627    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="d7cd8b3c3a4abd9a67b11aa983b1b4874dafb8412e0fda33a64de83651e89fcc" exitCode=0
Sep 19 01:15:17.793633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793633    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="809bed3b90189524b3bb651c4b45247fb9d71f6462b8f1dccbdd8877c7576db3" exitCode=0
Sep 19 01:15:17.793633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793639    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="c2c0fa901d30807ef9454225277d5618926172aa4b664a762f8b725b241c6bab" exitCode=0
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793644    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="3164b1d367edf051b5c788febef7450643efc0ca7e02222dbfa7e5b54e0759c8" exitCode=0
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"2a8d864a4bde7d5ac3fead6e5995d2fc7c74993a22fa9fde20cc74bf283501fa"}
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"d7cd8b3c3a4abd9a67b11aa983b1b4874dafb8412e0fda33a64de83651e89fcc"}
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"809bed3b90189524b3bb651c4b45247fb9d71f6462b8f1dccbdd8877c7576db3"}
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793793    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"c2c0fa901d30807ef9454225277d5618926172aa4b664a762f8b725b241c6bab"}
Sep 19 01:15:17.793861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:17.793824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"3164b1d367edf051b5c788febef7450643efc0ca7e02222dbfa7e5b54e0759c8"}
Sep 19 01:15:18.812440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.812413    2567 generic.go:356] "Generic (PLEG): container finished" podID="4163bfd2-0687-4fff-a858-d316d30e0897" containerID="ec345de85f344ac83890e75ac5cedf4f8f8e310e1c8a159e572ee4b35536c5cf" exitCode=0
Sep 19 01:15:18.812760 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.812473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"ec345de85f344ac83890e75ac5cedf4f8f8e310e1c8a159e572ee4b35536c5cf"}
Sep 19 01:15:18.812760 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.812523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4163bfd2-0687-4fff-a858-d316d30e0897","Type":"ContainerDied","Data":"b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a"}
Sep 19 01:15:18.812760 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.812551    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b32d8ba29c14834bb330478c94362f66794e9a4f3f5186ce2a5b524d0ac50a9a"
Sep 19 01:15:18.813106 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.813089    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:18.839515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839492    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839628 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839524    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839628 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839546    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839628 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839586    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839771    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839827    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.839907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839860    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839906    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839940    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:18.840003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839965    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.839999    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5r5d\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840058    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840087    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle\") pod \"4163bfd2-0687-4fff-a858-d316d30e0897\" (UID: \"4163bfd2-0687-4fff-a858-d316d30e0897\") "
Sep 19 01:15:18.840341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840198    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:15:18.840396 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840387    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-metrics-client-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.840452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840409    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-main-db\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.840780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.840746    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:18.842903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.842858    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out" (OuterVolumeSpecName: "config-out") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:15:18.843230 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.843194    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:15:18.843336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.843296    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.843398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.843356    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.843881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.843831    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.844414 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.843871    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume" (OuterVolumeSpecName: "config-volume") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.844513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.844425    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d" (OuterVolumeSpecName: "kube-api-access-s5r5d") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "kube-api-access-s5r5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:15:18.844574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.844542    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.849360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.849339    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.857191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.857135    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config" (OuterVolumeSpecName: "web-config") pod "4163bfd2-0687-4fff-a858-d316d30e0897" (UID: "4163bfd2-0687-4fff-a858-d316d30e0897"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:18.941269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941246    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-web-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941267    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941277    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-tls-assets\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941286    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941293    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-cluster-tls-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941302    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5r5d\" (UniqueName: \"kubernetes.io/projected/4163bfd2-0687-4fff-a858-d316d30e0897-kube-api-access-s5r5d\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941311    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941320    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4163bfd2-0687-4fff-a858-d316d30e0897-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941328    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-main-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941336    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4163bfd2-0687-4fff-a858-d316d30e0897-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:18.941400 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:18.941344    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4163bfd2-0687-4fff-a858-d316d30e0897-config-out\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:19.816051 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.816021    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.850501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.850466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:19.869197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.869137    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:19.930528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930508    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:19.930776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930765    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-metric"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930779    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-metric"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930789    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="config-reloader"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930795    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="config-reloader"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930807    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930813    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy"
Sep 19 01:15:19.930818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930819    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="prom-label-proxy"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930825    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="prom-label-proxy"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930831    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="init-config-reloader"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930836    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="init-config-reloader"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930843    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="alertmanager"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930848    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="alertmanager"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930859    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="116f24e3-cf19-48b4-9d07-332766487aa9" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930864    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="116f24e3-cf19-48b4-9d07-332766487aa9" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930869    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-web"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930874    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-web"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930881    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8257bec-a892-4808-a369-87c5ca9e0f4b" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930885    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8257bec-a892-4808-a369-87c5ca9e0f4b" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930939    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930947    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="alertmanager"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930953    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8257bec-a892-4808-a369-87c5ca9e0f4b" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930961    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="config-reloader"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930966    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-metric"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930971    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="116f24e3-cf19-48b4-9d07-332766487aa9" containerName="console"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930976    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="kube-rbac-proxy-web"
Sep 19 01:15:19.931015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.930981    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" containerName="prom-label-proxy"
Sep 19 01:15:19.934101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.934085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.943894 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.943878    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 01:15:19.944503 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.944469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 01:15:19.944609 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.944564    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xzmpp\""
Sep 19 01:15:19.944793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.944778    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 01:15:19.944845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.944829    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 01:15:19.945119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.945105    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 01:15:19.945179 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.945150    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 01:15:19.945450 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.945437    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 01:15:19.945583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.945568    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 01:15:19.947161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947142    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l786z\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-kube-api-access-l786z\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947345 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947386 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947453    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947527    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947598 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947598 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947581    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947707 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947707 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947641    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.947707 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.947666    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:19.950195 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:19.950178    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 01:15:20.047056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.047030    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:20.048448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048483    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048534    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048565    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.048673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l786z\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-kube-api-access-l786z\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.049021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.049021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.049021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.048772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.049518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.049253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.049857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.049679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.050650 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.050184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052279    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052678    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-volume\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.052964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.052846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.053318 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.053295    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-config-out\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.053848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.053820    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-web-config\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.053961 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.053875    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.059577 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.059555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l786z\" (UniqueName: \"kubernetes.io/projected/3cdb90c5-8737-4818-a24e-8b1ebe63a74e-kube-api-access-l786z\") pod \"alertmanager-main-0\" (UID: \"3cdb90c5-8737-4818-a24e-8b1ebe63a74e\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.242588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.242533    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 01:15:20.522772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.522749    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 01:15:20.524224 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:15:20.524198    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdb90c5_8737_4818_a24e_8b1ebe63a74e.slice/crio-74c56f75affc9b2372db52df40dee26808ba7ad56889795afae19317f552108b WatchSource:0}: Error finding container 74c56f75affc9b2372db52df40dee26808ba7ad56889795afae19317f552108b: Status 404 returned error can't find the container with id 74c56f75affc9b2372db52df40dee26808ba7ad56889795afae19317f552108b
Sep 19 01:15:20.821219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.821191    2567 generic.go:356] "Generic (PLEG): container finished" podID="3cdb90c5-8737-4818-a24e-8b1ebe63a74e" containerID="fa55e514f9de774cc491fdde164e161b8051a266816ec49b80613c6b134c5b27" exitCode=0
Sep 19 01:15:20.821558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.821275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerDied","Data":"fa55e514f9de774cc491fdde164e161b8051a266816ec49b80613c6b134c5b27"}
Sep 19 01:15:20.821558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.821339    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"74c56f75affc9b2372db52df40dee26808ba7ad56889795afae19317f552108b"}
Sep 19 01:15:20.920115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:20.920089    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4163bfd2-0687-4fff-a858-d316d30e0897" path="/var/lib/kubelet/pods/4163bfd2-0687-4fff-a858-d316d30e0897/volumes"
Sep 19 01:15:21.822363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822333    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:21.822829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822711    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="prometheus" containerID="cri-o://c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244" gracePeriod=600
Sep 19 01:15:21.822829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822737    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy" containerID="cri-o://a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e" gracePeriod=600
Sep 19 01:15:21.822829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822769    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f" gracePeriod=600
Sep 19 01:15:21.823043 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822876    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="config-reloader" containerID="cri-o://d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716" gracePeriod=600
Sep 19 01:15:21.823043 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822897    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-web" containerID="cri-o://37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7" gracePeriod=600
Sep 19 01:15:21.823043 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.822878    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="thanos-sidecar" containerID="cri-o://35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e" gracePeriod=600
Sep 19 01:15:21.835543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835516    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"9142341fe47e7219d31ac45ec232d41aaca970dbf69116847be0d55d348c40f9"}
Sep 19 01:15:21.835648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835581    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"b8e9a3b9f43767faa7187be34e868f897208298b4f8f66ca0a0d1a70238a7854"}
Sep 19 01:15:21.835648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"6c486fe17e301afa60d2767325704ddd26f42113875e9e9b507ea5b30aaed96b"}
Sep 19 01:15:21.835737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"85b2d1d9cc48a5a3f11933ac2d0fc12d1d201b7e00da791ac692bb33c3a3596c"}
Sep 19 01:15:21.835737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"69dd5beb6811379291d8aba5f6c147e6a4d5d08d23b1afae5ca7924619899758"}
Sep 19 01:15:21.835737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.835694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3cdb90c5-8737-4818-a24e-8b1ebe63a74e","Type":"ContainerStarted","Data":"de10bd0f9122e95923c5b6109b3cc011fe804de3937e74e5a8d05af04d23d705"}
Sep 19 01:15:21.937117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:21.937057    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.922170775 podStartE2EDuration="2.93703356s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.862785ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:15:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:15:21.929841337 +0000 UTC m=+169.271289261" watchObservedRunningTime="2026-09-19 01:15:21.93703356 +0000 UTC m=+169.278481484"
Sep 19 01:15:22.075424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.075373    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.167773 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.167747    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.167907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.167789    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.167907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.167819    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.167907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.167847    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.167907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.167873    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168152 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168042    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168152 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6b6b\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168268 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168268 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168185    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168268 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168268 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168245    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168277    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168305    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168343    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168366    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168395    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168421    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168448    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168797 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168471    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.168797 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168505    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle\") pod \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\" (UID: \"d0ec986d-4e57-4506-8d93-bc675c2f9c87\") "
Sep 19 01:15:22.170998 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168153    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.171104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.168469    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.171104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.169384    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.171104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.170322    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.171104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.170896    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.171104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.170963    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.171377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.171113    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.171377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.171146    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.172175 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172144    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:15:22.172276 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172206    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.172334 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172291    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config" (OuterVolumeSpecName: "config") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.172401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172379    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.172536 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172495    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:22.172639 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172593    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b" (OuterVolumeSpecName: "kube-api-access-v6b6b") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "kube-api-access-v6b6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:15:22.172826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172802    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.172897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172885    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out" (OuterVolumeSpecName: "config-out") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:15:22.172980 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.172903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.173320 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.173304    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.173699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.173680    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:15:22.182204 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.182184    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config" (OuterVolumeSpecName: "web-config") pod "d0ec986d-4e57-4506-8d93-bc675c2f9c87" (UID: "d0ec986d-4e57-4506-8d93-bc675c2f9c87"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:22.269683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269663    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269681    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269691    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-web-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269699    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269706    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-db\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269714    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269722    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269731    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-grpc-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269739    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269748    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-configmap-metrics-client-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269756    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269763    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.269769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269772    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-metrics-client-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269781    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269789    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-kube-rbac-proxy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269797    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6b6b\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-kube-api-access-v6b6b\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269806    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d0ec986d-4e57-4506-8d93-bc675c2f9c87-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269814    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0ec986d-4e57-4506-8d93-bc675c2f9c87-tls-assets\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269822    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0ec986d-4e57-4506-8d93-bc675c2f9c87-config-out\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.270101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.269830    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0ec986d-4e57-4506-8d93-bc675c2f9c87-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:22.842392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842363    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f" exitCode=0
Sep 19 01:15:22.842392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842387    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e" exitCode=0
Sep 19 01:15:22.842392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842394    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7" exitCode=0
Sep 19 01:15:22.842392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842400    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e" exitCode=0
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842405    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716" exitCode=0
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842410    2567 generic.go:356] "Generic (PLEG): container finished" podID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244" exitCode=0
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842501    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842629    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842649    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842798    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"}
Sep 19 01:15:22.842839 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.842838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0ec986d-4e57-4506-8d93-bc675c2f9c87","Type":"ContainerDied","Data":"4e77d8efe2e3d2f93f75395390e2744f1df931315418272d7751ecc3bd038c57"}
Sep 19 01:15:22.851110 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.851090    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.857953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.857938    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.865516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.865487    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.868058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.868034    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:22.872736 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.872717    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.880449 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.880428    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.880565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.880547    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:22.887310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.887294    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.893453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.893437    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.893699 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.893682    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.893743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.893706    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.893743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.893724    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.893986 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.893972    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.894041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.893990    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.894041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894003    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.894201 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.894187    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.894237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894205    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.894237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894218    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.894422 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.894404    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.894462 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894428    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.894462 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894443    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.894646 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.894632    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.894682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894649    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.894682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894662    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.894881 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.894864    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.894951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894883    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.894951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.894894    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.895257 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:22.895243    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.895305 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895260    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.895305 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895274    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.895517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895500    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.895517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895516    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.895722 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895705    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.895722 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895721    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.895955 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895934    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.896003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.895956    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.896154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896138    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.896191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896155    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.896365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896349    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.896365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896363    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.896549 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896535    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.896594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896549    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.896753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896738    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.896753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896753    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.896964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896947    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.897010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.896964    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.897157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897143    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.897193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897157    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.897339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897325    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.897380 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897340    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.897540 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897525    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.897581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897542    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.897719 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897705    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.897755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897720    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.897936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897902    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.897981 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.897938    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.898165 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898146    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.898209 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898165    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.898388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898372    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.898441 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898388    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.898612 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898592    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.898659 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898614    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.898825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898811    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.898875 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.898833    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.899078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899062    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.899150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899080    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.899314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899299    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.899314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899313    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.899508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899490    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.899560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899509    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.899729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899711    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.899774 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899738    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.899992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899971    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.900068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.899994    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.900211 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900196    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.900257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900212    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.900408 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900389    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.900476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900408    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.900601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900583    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.900601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900598    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.900833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900816    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.900833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.900832    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.901059 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901044    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.901059 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901058    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.901267 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901248    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.901314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901269    2567 scope.go:117] "RemoveContainer" containerID="1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"
Sep 19 01:15:22.901457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901441    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f"} err="failed to get container status \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": rpc error: code = NotFound desc = could not find container \"1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f\": container with ID starting with 1f76b55a340292cca03322a5ec10561c1f1708db1243e3fc7102cdb6219f3d9f not found: ID does not exist"
Sep 19 01:15:22.901499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901456    2567 scope.go:117] "RemoveContainer" containerID="a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"
Sep 19 01:15:22.901689 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901672    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e"} err="failed to get container status \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": rpc error: code = NotFound desc = could not find container \"a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e\": container with ID starting with a6fb008974528f629268580cccd5041a83bf884401cf1788f84b3b7d1ff6348e not found: ID does not exist"
Sep 19 01:15:22.901728 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901690    2567 scope.go:117] "RemoveContainer" containerID="37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"
Sep 19 01:15:22.901906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901882    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7"} err="failed to get container status \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": rpc error: code = NotFound desc = could not find container \"37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7\": container with ID starting with 37ef924a9e41be227ded0c1497bb3266c3f274e0a5ffc6de5ad1d63dbd9f3af7 not found: ID does not exist"
Sep 19 01:15:22.901906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.901905    2567 scope.go:117] "RemoveContainer" containerID="35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"
Sep 19 01:15:22.902182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902159    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e"} err="failed to get container status \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": rpc error: code = NotFound desc = could not find container \"35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e\": container with ID starting with 35949eaa60c0038b4de4fb81ace7fb65af887782dcf371571736c5d2cb671a9e not found: ID does not exist"
Sep 19 01:15:22.902243 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902184    2567 scope.go:117] "RemoveContainer" containerID="d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"
Sep 19 01:15:22.902465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902446    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716"} err="failed to get container status \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": rpc error: code = NotFound desc = could not find container \"d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716\": container with ID starting with d7c644496e2963594dc7db2603de030d9dfa38f34cee405e9d43b2c28ed9f716 not found: ID does not exist"
Sep 19 01:15:22.902506 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902465    2567 scope.go:117] "RemoveContainer" containerID="c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"
Sep 19 01:15:22.902715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902686    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244"} err="failed to get container status \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": rpc error: code = NotFound desc = could not find container \"c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244\": container with ID starting with c2d7e1331e2e54f2f090f37a6026fbec149344d364b931ff413bb3b93fb2c244 not found: ID does not exist"
Sep 19 01:15:22.902715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902702    2567 scope.go:117] "RemoveContainer" containerID="36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"
Sep 19 01:15:22.902976 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.902956    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55"} err="failed to get container status \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": rpc error: code = NotFound desc = could not find container \"36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55\": container with ID starting with 36a25a27e3198341a18b44e49fb2f20b79ac50a45c9baaf4a6ce906cdafa3c55 not found: ID does not exist"
Sep 19 01:15:22.920113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920083    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" path="/var/lib/kubelet/pods/d0ec986d-4e57-4506-8d93-bc675c2f9c87/volumes"
Sep 19 01:15:22.920592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920575    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:22.920864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920849    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="init-config-reloader"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920869    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="init-config-reloader"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920879    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="thanos-sidecar"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="thanos-sidecar"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920906    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-web"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920931    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-web"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920944    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-thanos"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920952    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-thanos"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920970    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920979    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.920994    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="config-reloader"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921002    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="config-reloader"
Sep 19 01:15:22.921013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921014    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="prometheus"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921022    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="prometheus"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921105    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921119    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="prometheus"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921127    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-web"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921136    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="thanos-sidecar"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921144    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="kube-rbac-proxy-thanos"
Sep 19 01:15:22.921561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.921154    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ec986d-4e57-4506-8d93-bc675c2f9c87" containerName="config-reloader"
Sep 19 01:15:22.925378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.925361    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.931705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931491    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 01:15:22.931705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931687    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 01:15:22.931813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931725    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 01:15:22.931981 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931964    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 01:15:22.931981 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931978    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 01:15:22.932101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.931986    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 01:15:22.932146 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.932127    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 01:15:22.932220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.932189    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 01:15:22.932532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.932514    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 01:15:22.933456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.933254    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ea62dkof4iugc\""
Sep 19 01:15:22.933456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.933372    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 01:15:22.935930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.933769    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 01:15:22.935930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.933848    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6lchc\""
Sep 19 01:15:22.935930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.935197    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 01:15:22.939114 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.939072    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 01:15:22.939302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.939286    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 01:15:22.941859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.941838    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 01:15:22.944815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.944799    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:22.974071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974086    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-web-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974205    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974262    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974306    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974461    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974533 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tskcf\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-kube-api-access-tskcf\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974591 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974678    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974723    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:22.974910 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:22.974891    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-config-out\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.076239 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.076356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-web-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.076356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076263    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.076356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.076356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076667    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076713    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076763    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tskcf\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-kube-api-access-tskcf\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076809    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076952    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.076999    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.077030    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.077062    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-config-out\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.077560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.077087    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.078426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.077331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.078426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.077950    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.079665    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080583    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080615    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080635    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.080663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-web-config\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.080738    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79ff507e-e262-4655-9bf6-f325bec7306e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.081604    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.081631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081791 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.081701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081791 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.081742    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.081900 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.081823    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.082060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.082043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.082198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.082179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79ff507e-e262-4655-9bf6-f325bec7306e-config-out\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.083270 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.083253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79ff507e-e262-4655-9bf6-f325bec7306e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.086491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.086475    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tskcf\" (UniqueName: \"kubernetes.io/projected/79ff507e-e262-4655-9bf6-f325bec7306e-kube-api-access-tskcf\") pod \"prometheus-k8s-0\" (UID: \"79ff507e-e262-4655-9bf6-f325bec7306e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.235468 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.235404    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:23.526604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.526580    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 01:15:23.527654 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:15:23.527632    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ff507e_e262_4655_9bf6_f325bec7306e.slice/crio-4b7ff99a88d71584f63734fc8efeeff1eac8df3090403b67f832facdf75447dd WatchSource:0}: Error finding container 4b7ff99a88d71584f63734fc8efeeff1eac8df3090403b67f832facdf75447dd: Status 404 returned error can't find the container with id 4b7ff99a88d71584f63734fc8efeeff1eac8df3090403b67f832facdf75447dd
Sep 19 01:15:23.849358 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.849323    2567 generic.go:356] "Generic (PLEG): container finished" podID="79ff507e-e262-4655-9bf6-f325bec7306e" containerID="54d3914f514304311f0f3310cf727629f3e40e364411999ed97095f6882da791" exitCode=0
Sep 19 01:15:23.849670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.849390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerDied","Data":"54d3914f514304311f0f3310cf727629f3e40e364411999ed97095f6882da791"}
Sep 19 01:15:23.849670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:23.849456    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"4b7ff99a88d71584f63734fc8efeeff1eac8df3090403b67f832facdf75447dd"}
Sep 19 01:15:24.857096 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857063    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"9bd9850986e7b530ad533dd0e184fc1ffff3f8a120fc13645bf230a3f4075e90"}
Sep 19 01:15:24.857524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"f99b0afd675fa751d4038f7aebd86aad82a7395e52a4b1731c7245fde77e3d66"}
Sep 19 01:15:24.857524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857184    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"d2f0cc7dce26d886405317b25fcfce464957cc643f21e75abc9055beb0ab4907"}
Sep 19 01:15:24.857524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857228    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"ced30169ab99fae98d01e1d3822b233f01f1cd15f8e3a1a1d8bf96ca65ba966a"}
Sep 19 01:15:24.857524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"d53062ab3dcb590837411a2ca81d9f95074d196a29bde60824962d9773a1584b"}
Sep 19 01:15:24.857524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.857309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79ff507e-e262-4655-9bf6-f325bec7306e","Type":"ContainerStarted","Data":"5c9c1567c5338b3344c935049c2256237c9f9a9f4883a7d387a3729f77fae2b7"}
Sep 19 01:15:24.896056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:24.895995    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.874644151 podStartE2EDuration="2.895973166s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.329015ms" isStatefulPod=false podCreationTimestamp="2026-09-19 01:15:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:15:24.887787486 +0000 UTC m=+172.229235410" watchObservedRunningTime="2026-09-19 01:15:24.895973166 +0000 UTC m=+172.237421093"
Sep 19 01:15:25.033797 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:25.033766    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:25.135397 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:25.135310    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:26.100779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:26.100747    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:15:26.229397 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:26.229360    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:26.331207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:26.331177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:26.417207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:26.417147    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:28.235682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:28.235650    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:15:37.795430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:37.795392    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:37.896249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:37.896212    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:15:51.119249 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.119204    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5c8dc855c9-vjgzf" podUID="193f4dab-ffe1-4b11-a785-866dfcccec23" containerName="console" containerID="cri-o://39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c" gracePeriod=15
Sep 19 01:15:51.365183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.365161    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:15:51.495453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495394    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495427    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495445    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495466    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495510    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495538    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqr9z\" (UniqueName: \"kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495574    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert\") pod \"193f4dab-ffe1-4b11-a785-866dfcccec23\" (UID: \"193f4dab-ffe1-4b11-a785-866dfcccec23\") "
Sep 19 01:15:51.495949 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495887    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca" (OuterVolumeSpecName: "service-ca") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:51.495949 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495896    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:51.496123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.495988    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:51.496123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.496039    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config" (OuterVolumeSpecName: "console-config") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:15:51.497644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.497614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:51.497724 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.497672    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z" (OuterVolumeSpecName: "kube-api-access-vqr9z") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "kube-api-access-vqr9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:15:51.497764 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.497732    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "193f4dab-ffe1-4b11-a785-866dfcccec23" (UID: "193f4dab-ffe1-4b11-a785-866dfcccec23"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:15:51.596210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596187    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596208    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-oauth-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596218    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-trusted-ca-bundle\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596226    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-console-config\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596234    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/193f4dab-ffe1-4b11-a785-866dfcccec23-oauth-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596244    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqr9z\" (UniqueName: \"kubernetes.io/projected/193f4dab-ffe1-4b11-a785-866dfcccec23-kube-api-access-vqr9z\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.596335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.596252    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/193f4dab-ffe1-4b11-a785-866dfcccec23-console-serving-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:15:51.965489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.965452    2567 generic.go:356] "Generic (PLEG): container finished" podID="193f4dab-ffe1-4b11-a785-866dfcccec23" containerID="39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c" exitCode=0
Sep 19 01:15:51.965649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.965501    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c8dc855c9-vjgzf"
Sep 19 01:15:51.965649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.965534    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dc855c9-vjgzf" event={"ID":"193f4dab-ffe1-4b11-a785-866dfcccec23","Type":"ContainerDied","Data":"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"}
Sep 19 01:15:51.965649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.965573    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c8dc855c9-vjgzf" event={"ID":"193f4dab-ffe1-4b11-a785-866dfcccec23","Type":"ContainerDied","Data":"fac1feab10aaeddeac9418d3199171f124fae902503b07f7aaec8fb66e5ada5b"}
Sep 19 01:15:51.965649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.965594    2567 scope.go:117] "RemoveContainer" containerID="39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"
Sep 19 01:15:51.973841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.973825    2567 scope.go:117] "RemoveContainer" containerID="39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"
Sep 19 01:15:51.974130 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:15:51.974110    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c\": container with ID starting with 39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c not found: ID does not exist" containerID="39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"
Sep 19 01:15:51.974189 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.974137    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c"} err="failed to get container status \"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c\": rpc error: code = NotFound desc = could not find container \"39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c\": container with ID starting with 39d961bab22838b4cab8f986ea83b5d178ef001e1e40af3c620fe583aa9d5d3c not found: ID does not exist"
Sep 19 01:15:51.989531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.989504    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:15:51.995755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:51.995733    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c8dc855c9-vjgzf"]
Sep 19 01:15:52.919371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:15:52.919330    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="193f4dab-ffe1-4b11-a785-866dfcccec23" path="/var/lib/kubelet/pods/193f4dab-ffe1-4b11-a785-866dfcccec23/volumes"
Sep 19 01:16:04.559127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:04.559082    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:04.656057 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:04.656032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:12.444613 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:12.444577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:12.545933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:12.545890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:23.236280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:23.236254    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:16:23.251200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:23.251177    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:16:24.106100 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:24.106073    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 01:16:26.771422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:26.771386    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:27.103754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:27.103716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:30.374161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:30.374126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:30.448078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:30.448051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:35.515730 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:35.515693    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:35.654202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:35.654171    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:35.837098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:35.837069    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:35.981709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:35.981681    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:37.797278 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:37.797248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:38.100879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:38.100796    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:43.084935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:43.084884    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:46.330987 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:46.330951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:49.749910 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:49.749869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:49.983875 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:49.983842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:54.599608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:54.599575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:54.709434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:54.709398    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:55.211523 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:55.211480    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:55.311930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:55.311893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:16:57.989519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:16:57.989489    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:12.298652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.298611    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:12.391183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.391151    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"]
Sep 19 01:17:12.391480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.391468    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="193f4dab-ffe1-4b11-a785-866dfcccec23" containerName="console"
Sep 19 01:17:12.391524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.391483    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="193f4dab-ffe1-4b11-a785-866dfcccec23" containerName="console"
Sep 19 01:17:12.391558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.391528    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="193f4dab-ffe1-4b11-a785-866dfcccec23" containerName="console"
Sep 19 01:17:12.393257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.393243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.402307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.402289    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 19 01:17:12.402559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.402544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 19 01:17:12.403417 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.403395    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nzkht\""
Sep 19 01:17:12.403417 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.403410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 19 01:17:12.403545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.403483    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 19 01:17:12.403545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.403503    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 19 01:17:12.418011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.417986    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"]
Sep 19 01:17:12.444261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.444239    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:12.473610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.473590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99f5bfac-5429-464e-8346-72d2e9db0b37-manager-config\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.473703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.473626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.473703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.473646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpgzm\" (UniqueName: \"kubernetes.io/projected/99f5bfac-5429-464e-8346-72d2e9db0b37-kube-api-access-mpgzm\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.473703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.473685    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-metrics-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.574968 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.574896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99f5bfac-5429-464e-8346-72d2e9db0b37-manager-config\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.574968 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.574946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.574968 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.574967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpgzm\" (UniqueName: \"kubernetes.io/projected/99f5bfac-5429-464e-8346-72d2e9db0b37-kube-api-access-mpgzm\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.575177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.574998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-metrics-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.575608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.575589    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/99f5bfac-5429-464e-8346-72d2e9db0b37-manager-config\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.577350 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.577330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.577440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.577385    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/99f5bfac-5429-464e-8346-72d2e9db0b37-metrics-cert\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.598757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.598737    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpgzm\" (UniqueName: \"kubernetes.io/projected/99f5bfac-5429-464e-8346-72d2e9db0b37-kube-api-access-mpgzm\") pod \"lws-controller-manager-74c67d8b6f-cqhmx\" (UID: \"99f5bfac-5429-464e-8346-72d2e9db0b37\") " pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.701973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.701953    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:12.979942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:12.979745    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"]
Sep 19 01:17:12.982443 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:12.982416    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99f5bfac_5429_464e_8346_72d2e9db0b37.slice/crio-009d63508da61c95ecf67558c1c3fd7e534d006fe355ea922b5094da2c78bf6d WatchSource:0}: Error finding container 009d63508da61c95ecf67558c1c3fd7e534d006fe355ea922b5094da2c78bf6d: Status 404 returned error can't find the container with id 009d63508da61c95ecf67558c1c3fd7e534d006fe355ea922b5094da2c78bf6d
Sep 19 01:17:13.101051 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:13.101022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:13.274594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:13.274516    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx" event={"ID":"99f5bfac-5429-464e-8346-72d2e9db0b37","Type":"ContainerStarted","Data":"009d63508da61c95ecf67558c1c3fd7e534d006fe355ea922b5094da2c78bf6d"}
Sep 19 01:17:13.295578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:13.295540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:13.965116 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:13.965063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:14.633490 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.633448    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:14.729028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.728965    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:14.810184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.810152    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"]
Sep 19 01:17:14.816401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.816373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.819751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.819727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 01:17:14.820047 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.820031    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 01:17:14.820671 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.820652    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 01:17:14.821253 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.821184    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 01:17:14.821372 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.821289    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-h4tpm\""
Sep 19 01:17:14.850251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.850213    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"]
Sep 19 01:17:14.896115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.896047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-tmp\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.896115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.896092    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-webhook-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.896289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.896132    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-manifests\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.896289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.896160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.896289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.896183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pdqk\" (UniqueName: \"kubernetes.io/projected/c31d24a9-403a-47d3-8096-a46efd95cde0-kube-api-access-4pdqk\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-tmp\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-webhook-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997183    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-manifests\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997339    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pdqk\" (UniqueName: \"kubernetes.io/projected/c31d24a9-403a-47d3-8096-a46efd95cde0-kube-api-access-4pdqk\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:14.997594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.997505    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-manifests\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.000139 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.999895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c31d24a9-403a-47d3-8096-a46efd95cde0-tmp\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.000139 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:14.999995    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.000323 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.000230    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c31d24a9-403a-47d3-8096-a46efd95cde0-webhook-cert\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.006717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.006699    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pdqk\" (UniqueName: \"kubernetes.io/projected/c31d24a9-403a-47d3-8096-a46efd95cde0-kube-api-access-4pdqk\") pod \"opendatahub-operator-controller-manager-748475db69-f4cnd\" (UID: \"c31d24a9-403a-47d3-8096-a46efd95cde0\") " pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.024790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.024763    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.127093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.127044    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.129819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.129795    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:15.226798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.226723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.330025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.329994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.428052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.428015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.539962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.538295    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:15.711674 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:15.711648    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"]
Sep 19 01:17:15.713722 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:15.713692    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31d24a9_403a_47d3_8096_a46efd95cde0.slice/crio-6ad7f38b14f97706150371aaece6a9cb9d4e421037daad79080f62b99a514704 WatchSource:0}: Error finding container 6ad7f38b14f97706150371aaece6a9cb9d4e421037daad79080f62b99a514704: Status 404 returned error can't find the container with id 6ad7f38b14f97706150371aaece6a9cb9d4e421037daad79080f62b99a514704
Sep 19 01:17:16.291539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:16.291498    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx" event={"ID":"99f5bfac-5429-464e-8346-72d2e9db0b37","Type":"ContainerStarted","Data":"e5ea3f5bd52f91c882ca83ec56e32cb357e79f0c5ed2bb04d52358ae47556f14"}
Sep 19 01:17:16.292027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:16.291568    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:16.293069 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:16.293045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd" event={"ID":"c31d24a9-403a-47d3-8096-a46efd95cde0","Type":"ContainerStarted","Data":"6ad7f38b14f97706150371aaece6a9cb9d4e421037daad79080f62b99a514704"}
Sep 19 01:17:16.312237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:16.312197    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx" podStartSLOduration=1.8148918379999999 podStartE2EDuration="4.312183003s" totalImagesPullingTime="2.497291165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:16.310489354 +0000 UTC m=+283.651937291" watchObservedRunningTime="2026-09-19 01:17:16.312183003 +0000 UTC m=+283.653630983"
Sep 19 01:17:19.309621 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:19.309587    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd" event={"ID":"c31d24a9-403a-47d3-8096-a46efd95cde0","Type":"ContainerStarted","Data":"939e18b66620313ab9c3b45392a3652559faf8dcb2b02a467ad40cc67ca96c8a"}
Sep 19 01:17:20.316002 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:20.315966    2567 generic.go:356] "Generic (PLEG): container finished" podID="c31d24a9-403a-47d3-8096-a46efd95cde0" containerID="939e18b66620313ab9c3b45392a3652559faf8dcb2b02a467ad40cc67ca96c8a" exitCode=0
Sep 19 01:17:20.316424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:20.316028    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd" event={"ID":"c31d24a9-403a-47d3-8096-a46efd95cde0","Type":"ContainerDied","Data":"939e18b66620313ab9c3b45392a3652559faf8dcb2b02a467ad40cc67ca96c8a"}
Sep 19 01:17:21.323640 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:21.323597    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd" event={"ID":"c31d24a9-403a-47d3-8096-a46efd95cde0","Type":"ContainerStarted","Data":"2e9a9ed29b2bb5ecf612050249f0c8df99f15765fe1218b5e67bd5da626f719d"}
Sep 19 01:17:21.324107 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:21.323715    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:21.356141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:21.356090    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd" podStartSLOduration=2.988403593 podStartE2EDuration="7.356070455s" totalImagesPullingTime="3.334984849s" totalInitContainerRuntime="1.032682013s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:21.354650258 +0000 UTC m=+288.696098183" watchObservedRunningTime="2026-09-19 01:17:21.356070455 +0000 UTC m=+288.697518380"
Sep 19 01:17:26.468220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:26.468151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:26.567879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:26.567845    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:27.302173 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:27.302144    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-74c67d8b6f-cqhmx"
Sep 19 01:17:30.130380 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:30.130336    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:31.732255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:31.732219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:32.328971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:32.328906    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-748475db69-f4cnd"
Sep 19 01:17:34.253869 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.253826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:34.415983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.415950    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:34.848530 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.848502    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:17:34.848530 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.848521    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:17:34.851985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.851961    2567 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 01:17:34.961958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:34.961790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:35.422531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:35.213677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:36.748848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:36.748813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:36.864729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:36.864698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:38.632189 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:38.632149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:41.860736 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:41.860706    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:41.998215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:41.998169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:42.105638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.105608    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:42.113060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.113002    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.115944 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.115910    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6kllk\""
Sep 19 01:17:42.116174 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.116156    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 01:17:42.116227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.116211    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 01:17:42.117291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.117269    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 01:17:42.127007 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.126981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:42.136223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.136195    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:42.214062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.214039    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"]
Sep 19 01:17:42.216263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.216247    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.218512 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218599 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218599    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218652    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mc8r\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218822 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218742    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218822 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218773    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.218901 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.218836    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.234214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.234193    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"]
Sep 19 01:17:42.271617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.271586    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:42.319804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319810    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319855    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mc8r\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.319981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320403    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-694ns\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-kube-api-access-694ns\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320538    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320541    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320656    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.320725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320706    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.321161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320753    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.321161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.321161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.320823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.321161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.321040    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.321385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.321239    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.322702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.322673    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.322852 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.322834    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.335593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.335574    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.336487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.336471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mc8r\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bc85wp5\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.362812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.362786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:42.421679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.421621    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.421679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.421646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.421810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.421683    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.421988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.421967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-694ns\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-kube-api-access-694ns\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422031    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422436    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.422614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.422490    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.423702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.423681    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:42.424287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.424270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.424547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.424532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.430713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.430691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.431032 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.431007    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-694ns\" (UniqueName: \"kubernetes.io/projected/c7c0f69e-677c-4d39-8d3f-c2df629daf7e-kube-api-access-694ns\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5\" (UID: \"c7c0f69e-677c-4d39-8d3f-c2df629daf7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.526431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.526395    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:42.696539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.696504    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:42.697899 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:42.697872    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15a2fa0c_3774_4e1f_893c_78af74a0eb3c.slice/crio-ac00b30b143421ac576366af1d93c800c3ef91c0ce0184e61a8aae7674a7e304 WatchSource:0}: Error finding container ac00b30b143421ac576366af1d93c800c3ef91c0ce0184e61a8aae7674a7e304: Status 404 returned error can't find the container with id ac00b30b143421ac576366af1d93c800c3ef91c0ce0184e61a8aae7674a7e304
Sep 19 01:17:42.699829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.699809    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 01:17:42.801363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:42.801334    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"]
Sep 19 01:17:42.804099 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:42.804069    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c0f69e_677c_4d39_8d3f_c2df629daf7e.slice/crio-5b42b5a4d63137f6c795b87327e43d825589e4fa31ad5fd2c3da1103b1e730de WatchSource:0}: Error finding container 5b42b5a4d63137f6c795b87327e43d825589e4fa31ad5fd2c3da1103b1e730de: Status 404 returned error can't find the container with id 5b42b5a4d63137f6c795b87327e43d825589e4fa31ad5fd2c3da1103b1e730de
Sep 19 01:17:43.427569 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:43.427532    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5" event={"ID":"c7c0f69e-677c-4d39-8d3f-c2df629daf7e","Type":"ContainerStarted","Data":"5b42b5a4d63137f6c795b87327e43d825589e4fa31ad5fd2c3da1103b1e730de"}
Sep 19 01:17:43.429126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:43.429090    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" event={"ID":"15a2fa0c-3774-4e1f-893c-78af74a0eb3c","Type":"ContainerStarted","Data":"ac00b30b143421ac576366af1d93c800c3ef91c0ce0184e61a8aae7674a7e304"}
Sep 19 01:17:45.338867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.338824    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m7sn"]
Sep 19 01:17:45.344382 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.344359    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.347418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.347330    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kqxl6\""
Sep 19 01:17:45.347418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.347375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 19 01:17:45.360651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.360632    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m7sn"]
Sep 19 01:17:45.408611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.408573    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:45.453108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.453075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dblzp\" (UniqueName: \"kubernetes.io/projected/97b74574-876b-4bc6-8d69-fc90ac46d057-kube-api-access-dblzp\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.453296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.453128    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.510742 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.510705    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:45.554617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.554580    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.554797 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:17:45.554724    2567 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 19 01:17:45.554797 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:17:45.554789    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert podName:97b74574-876b-4bc6-8d69-fc90ac46d057 nodeName:}" failed. No retries permitted until 2026-09-19 01:17:46.054770161 +0000 UTC m=+313.396218064 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert") pod "odh-model-controller-7998c67dc4-6m7sn" (UID: "97b74574-876b-4bc6-8d69-fc90ac46d057") : secret "odh-model-controller-webhook-cert" not found
Sep 19 01:17:45.554958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.554720    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dblzp\" (UniqueName: \"kubernetes.io/projected/97b74574-876b-4bc6-8d69-fc90ac46d057-kube-api-access-dblzp\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.564935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.564891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dblzp\" (UniqueName: \"kubernetes.io/projected/97b74574-876b-4bc6-8d69-fc90ac46d057-kube-api-access-dblzp\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:45.610623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.610534    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:45.712510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.712471    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:45.760518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.760479    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:45.760633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.760549    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:45.760633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.760580    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:45.767184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.767154    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:45.767263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.767225    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:45.767302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:45.767264    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:46.058108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.058024    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:46.061336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.061297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97b74574-876b-4bc6-8d69-fc90ac46d057-cert\") pod \"odh-model-controller-7998c67dc4-6m7sn\" (UID: \"97b74574-876b-4bc6-8d69-fc90ac46d057\") " pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:46.088250 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.088216    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:46.256126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.256088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:46.452282 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.452169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" event={"ID":"15a2fa0c-3774-4e1f-893c-78af74a0eb3c","Type":"ContainerStarted","Data":"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"}
Sep 19 01:17:46.454697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.454671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5" event={"ID":"c7c0f69e-677c-4d39-8d3f-c2df629daf7e","Type":"ContainerStarted","Data":"ec962f92233c79862e08891369c610185dc1c6b9d8d5cb4d1591a5c82415aa4c"}
Sep 19 01:17:46.473734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.473684    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" podStartSLOduration=1.413393139 podStartE2EDuration="4.473666648s" totalImagesPullingTime="3.060273509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:46.473475202 +0000 UTC m=+313.814923126" watchObservedRunningTime="2026-09-19 01:17:46.473666648 +0000 UTC m=+313.815114571"
Sep 19 01:17:46.497930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.497865    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5" podStartSLOduration=1.53714566 podStartE2EDuration="4.497846405s" totalImagesPullingTime="2.960700745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:46.496625046 +0000 UTC m=+313.838072969" watchObservedRunningTime="2026-09-19 01:17:46.497846405 +0000 UTC m=+313.839294330"
Sep 19 01:17:46.504629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.504598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:46.527429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.527358    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:46.533076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.533052    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:46.549127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:46.549103    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-6m7sn"]
Sep 19 01:17:46.551582 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:46.551555    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b74574_876b_4bc6_8d69_fc90ac46d057.slice/crio-ab51269b72ef55195789ccc4e031b0b0d82023ed0ab71d2755d7a3cbd955f017 WatchSource:0}: Error finding container ab51269b72ef55195789ccc4e031b0b0d82023ed0ab71d2755d7a3cbd955f017: Status 404 returned error can't find the container with id ab51269b72ef55195789ccc4e031b0b0d82023ed0ab71d2755d7a3cbd955f017
Sep 19 01:17:47.425040 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.425009    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:47.426692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.426351    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 19 01:17:47.426692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.426409    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 19 01:17:47.463440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.463404    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn" event={"ID":"97b74574-876b-4bc6-8d69-fc90ac46d057","Type":"ContainerStarted","Data":"ab51269b72ef55195789ccc4e031b0b0d82023ed0ab71d2755d7a3cbd955f017"}
Sep 19 01:17:47.463885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.463857    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:47.465401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.465376    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5"
Sep 19 01:17:47.521356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:47.520712    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:48.424190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:48.424154    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 19 01:17:48.424391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:48.424221    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 19 01:17:49.424987 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:49.424957    2567 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 19 01:17:49.425293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:49.425018    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 19 01:17:49.482513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:49.482481    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn" event={"ID":"97b74574-876b-4bc6-8d69-fc90ac46d057","Type":"ContainerStarted","Data":"00c0b780643dfd816fa36f8499cf203a486768cb2eeae9a4f96ae1766b93b7c5"}
Sep 19 01:17:49.482721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:49.482696    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy" containerID="cri-o://69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454" gracePeriod=30
Sep 19 01:17:49.530467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:49.529838    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn" podStartSLOduration=1.6761654369999999 podStartE2EDuration="4.529815686s" totalImagesPullingTime="2.853650249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:49.528563821 +0000 UTC m=+316.870011744" watchObservedRunningTime="2026-09-19 01:17:49.529815686 +0000 UTC m=+316.871263610"
Sep 19 01:17:50.488567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:50.488532    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:17:53.204110 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.204080    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"]
Sep 19 01:17:53.207392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.207376    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.215073 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.215054    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 01:17:53.215389 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.215374    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 01:17:53.215470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.215375    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 01:17:53.215470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.215424    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jbgkf\""
Sep 19 01:17:53.219374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87bf380d-518d-4298-aef5-e5b7c2b13b2d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm58z\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-kube-api-access-dm58z\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219485    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219539    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.219712 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.219605    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.238726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.238701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"]
Sep 19 01:17:53.320425 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320393    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320461    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87bf380d-518d-4298-aef5-e5b7c2b13b2d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm58z\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-kube-api-access-dm58z\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.320894 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.320668    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.321336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.321302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.322853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.322835    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/87bf380d-518d-4298-aef5-e5b7c2b13b2d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.323027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.323005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.323272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.323253    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.323337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.323289    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.332049 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.332006    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm58z\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-kube-api-access-dm58z\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.333405 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.333386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87bf380d-518d-4298-aef5-e5b7c2b13b2d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fsb7x\" (UID: \"87bf380d-518d-4298-aef5-e5b7c2b13b2d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.516870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.516810    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:53.821021 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:17:53.820979    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bf380d_518d_4298_aef5_e5b7c2b13b2d.slice/crio-ba0974a812fa9478d8bf69d65af3e9a4c8f0373d2692cd7921f4a2f0ec89d56a WatchSource:0}: Error finding container ba0974a812fa9478d8bf69d65af3e9a4c8f0373d2692cd7921f4a2f0ec89d56a: Status 404 returned error can't find the container with id ba0974a812fa9478d8bf69d65af3e9a4c8f0373d2692cd7921f4a2f0ec89d56a
Sep 19 01:17:53.823480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:53.823456    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"]
Sep 19 01:17:54.507454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.507421    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x" event={"ID":"87bf380d-518d-4298-aef5-e5b7c2b13b2d","Type":"ContainerStarted","Data":"ba0974a812fa9478d8bf69d65af3e9a4c8f0373d2692cd7921f4a2f0ec89d56a"}
Sep 19 01:17:54.745037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.744972    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:54.836082 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836110    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836139    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836169    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836194    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836230    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836273    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mc8r\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836296    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836326    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token\") pod \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\" (UID: \"15a2fa0c-3774-4e1f-893c-78af74a0eb3c\") "
Sep 19 01:17:54.836629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836454    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:17:54.836629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836595    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.836827 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836802    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:17:54.836935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836820    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:17:54.837017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.836870    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:17:54.837065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.837018    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:17:54.838813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.838785    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:17:54.838967 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.838873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:17:54.839221 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.839194    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r" (OuterVolumeSpecName: "kube-api-access-6mc8r") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "kube-api-access-6mc8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:17:54.840058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.840018    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15a2fa0c-3774-4e1f-893c-78af74a0eb3c" (UID: "15a2fa0c-3774-4e1f-893c-78af74a0eb3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:17:54.937285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937252    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937283    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937298    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937312    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937326    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937338    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mc8r\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-kube-api-access-6mc8r\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937353    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:54.937495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:54.937367    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15a2fa0c-3774-4e1f-893c-78af74a0eb3c-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:17:55.514394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.514356    2567 generic.go:356] "Generic (PLEG): container finished" podID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerID="69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454" exitCode=0
Sep 19 01:17:55.514824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.514414    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"
Sep 19 01:17:55.514824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.514438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" event={"ID":"15a2fa0c-3774-4e1f-893c-78af74a0eb3c","Type":"ContainerDied","Data":"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"}
Sep 19 01:17:55.514824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.514499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5" event={"ID":"15a2fa0c-3774-4e1f-893c-78af74a0eb3c","Type":"ContainerDied","Data":"ac00b30b143421ac576366af1d93c800c3ef91c0ce0184e61a8aae7674a7e304"}
Sep 19 01:17:55.514824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.514526    2567 scope.go:117] "RemoveContainer" containerID="69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"
Sep 19 01:17:55.547113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.547059    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:55.550427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.550407    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bc85wp5"]
Sep 19 01:17:55.707830 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.707796    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:55.800321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:55.800287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:56.093423 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.093227    2567 scope.go:117] "RemoveContainer" containerID="69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"
Sep 19 01:17:56.093640 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:17:56.093612    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454\": container with ID starting with 69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454 not found: ID does not exist" containerID="69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"
Sep 19 01:17:56.093720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.093643    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454"} err="failed to get container status \"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454\": rpc error: code = NotFound desc = could not find container \"69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454\": container with ID starting with 69058ab63745c27cb89c96bb8f503ebc36200091a6c8abda4d48a2bd954bd454 not found: ID does not exist"
Sep 19 01:17:56.150823 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.150788    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:56.150959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.150865    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:17:56.520895 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.520809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x" event={"ID":"87bf380d-518d-4298-aef5-e5b7c2b13b2d","Type":"ContainerStarted","Data":"778ea03864ab6b541da16ac606b329487c3c1776309f0e9e15146df61797ca0a"}
Sep 19 01:17:56.520895 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.520861    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:17:56.858705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.858669    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:56.920717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:56.920687    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" path="/var/lib/kubelet/pods/15a2fa0c-3774-4e1f-893c-78af74a0eb3c/volumes"
Sep 19 01:17:57.135638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:57.135540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:57.312702 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:57.312661    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:57.527772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:57.527692    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-fsb7x container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 01:17:57.527772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:57.527739    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x" podUID="87bf380d-518d-4298-aef5-e5b7c2b13b2d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 01:17:57.580158 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:57.580123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:58.492126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:58.492095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:17:58.606514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:17:58.606479    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:18:00.526902 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:00.526874    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x"
Sep 19 01:18:00.551933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:00.551875    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fsb7x" podStartSLOduration=5.224889892 podStartE2EDuration="7.551862158s" totalImagesPullingTime="2.326972266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:17:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:17:56.578449083 +0000 UTC m=+323.919897006" watchObservedRunningTime="2026-09-19 01:18:00.551862158 +0000 UTC m=+327.893310081"
Sep 19 01:18:01.498362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:01.498336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-6m7sn"
Sep 19 01:18:43.772430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:43.772394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:18:43.859962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:43.859932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:18:46.444981 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:46.444937    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:18:46.535832 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:18:46.535798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:03.158402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:03.158364    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:03.957601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:03.957567    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:04.772700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:04.772663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:06.885620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:06.885572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:07.024129 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:07.024093    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:08.180481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:08.180438    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:08.372088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:08.372051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:08.474404 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:08.474325    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:10.090475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:10.090434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:10.213678 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:10.213640    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:11.988109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:11.988072    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:12.222517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:12.222479    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:12.396032 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:12.395996    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:12.502255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:12.502221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:13.636126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:13.636086    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:16.529447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:16.529404    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:16.875412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:16.875323    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:17.964339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:17.964305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:18.036592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:18.036555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:18.358660 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:18.358630    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:18.422350 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:18.422318    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:18.772333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:18.772256    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:18.873456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:18.873423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:19.631630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:19.631602    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:19.725254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:19.725228    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:24.997067 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:24.997028    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:25.101055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:25.101023    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:27.555687 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:27.555633    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:27.663495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:27.663451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:34.001874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:34.001842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:34.120491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:34.120461    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:39.264046 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:39.264013    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:39.365262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:39.365230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:39.757207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:39.757168    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:39.897351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:39.897315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:40.028589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:40.028505    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:46.412344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:46.412306    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:46.545932 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:46.545884    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:48.916297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:48.916266    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:49.019638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:49.019604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:55.420281 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:55.420239    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:55.526113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:55.526079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:56.155029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.154987    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"]
Sep 19 01:19:56.155412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.155394    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy"
Sep 19 01:19:56.155518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.155414    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy"
Sep 19 01:19:56.155518 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.155504    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="15a2fa0c-3774-4e1f-893c-78af74a0eb3c" containerName="istio-proxy"
Sep 19 01:19:56.158453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.158432    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.162395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.162379    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-55wf4\""
Sep 19 01:19:56.178517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.178498    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"]
Sep 19 01:19:56.195551 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.195517    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:56.291885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.291860    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.291897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.291984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292096    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292126    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sl9m\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-kube-api-access-5sl9m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.292266 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.292218    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.349105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.349050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:56.393547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393521    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393556    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393601    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sl9m\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-kube-api-access-5sl9m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393654    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.393946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.393765    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.394126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.394050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.394248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.394223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.394315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.394264    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.394433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.394412    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.395090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.395057    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.396460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.396431    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.396540 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.396440    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.402335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.402304    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.402466 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.402451    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sl9m\" (UniqueName: \"kubernetes.io/projected/69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8-kube-api-access-5sl9m\") pod \"maas-default-gateway-openshift-default-78bb78ff78-ks4rw\" (UID: \"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.469346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.469289    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:56.745465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.745360    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"]
Sep 19 01:19:56.747622 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:19:56.747594    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69871c7e_95b6_4a18_8d3e_2c3b5dc47cc8.slice/crio-ac4d2f8888ede71b274fb880aa0c5476c379efa9a7776df556c9d4361456df32 WatchSource:0}: Error finding container ac4d2f8888ede71b274fb880aa0c5476c379efa9a7776df556c9d4361456df32: Status 404 returned error can't find the container with id ac4d2f8888ede71b274fb880aa0c5476c379efa9a7776df556c9d4361456df32
Sep 19 01:19:56.749613 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.749582    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:19:56.749686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.749641    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:19:56.749686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:56.749666    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:19:57.049962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:57.049907    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" event={"ID":"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8","Type":"ContainerStarted","Data":"f56c4aa2ec3cad234a264f038c846b02a916c934aea73e3e57e3f842e634022d"}
Sep 19 01:19:57.050114 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:57.049986    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" event={"ID":"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8","Type":"ContainerStarted","Data":"ac4d2f8888ede71b274fb880aa0c5476c379efa9a7776df556c9d4361456df32"}
Sep 19 01:19:57.089101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:57.089058    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podStartSLOduration=1.089043431 podStartE2EDuration="1.089043431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:19:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:19:57.086620156 +0000 UTC m=+444.428068078" watchObservedRunningTime="2026-09-19 01:19:57.089043431 +0000 UTC m=+444.430491405"
Sep 19 01:19:57.469675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:57.469603    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:57.474373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:57.474350    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:58.054754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:58.054725    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:58.055737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:58.055715    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:19:58.130258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:58.130217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:58.233467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:58.233434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:58.335821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:58.335743    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:59.021986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:59.021948    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:19:59.138279 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:19:59.138247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:19.459905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:19.459855    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:19.591061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:19.591025    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:20.035417 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:20.035384    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:27.495967 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:27.495932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:27.566080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:27.566054    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:33.138831 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:33.138795    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:33.305190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:33.305156    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:34.872365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.872332    2567 scope.go:117] "RemoveContainer" containerID="2a8d864a4bde7d5ac3fead6e5995d2fc7c74993a22fa9fde20cc74bf283501fa"
Sep 19 01:20:34.880445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.880422    2567 scope.go:117] "RemoveContainer" containerID="809bed3b90189524b3bb651c4b45247fb9d71f6462b8f1dccbdd8877c7576db3"
Sep 19 01:20:34.888340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.888320    2567 scope.go:117] "RemoveContainer" containerID="ec345de85f344ac83890e75ac5cedf4f8f8e310e1c8a159e572ee4b35536c5cf"
Sep 19 01:20:34.896201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.896178    2567 scope.go:117] "RemoveContainer" containerID="9c2a3fca56a202563b1b055327b3829d0f11011b0877ca0eaf1b37ab66a2d3f7"
Sep 19 01:20:34.903039 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.903021    2567 scope.go:117] "RemoveContainer" containerID="d7cd8b3c3a4abd9a67b11aa983b1b4874dafb8412e0fda33a64de83651e89fcc"
Sep 19 01:20:34.911291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.911274    2567 scope.go:117] "RemoveContainer" containerID="c2c0fa901d30807ef9454225277d5618926172aa4b664a762f8b725b241c6bab"
Sep 19 01:20:34.919246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:34.919230    2567 scope.go:117] "RemoveContainer" containerID="3164b1d367edf051b5c788febef7450643efc0ca7e02222dbfa7e5b54e0759c8"
Sep 19 01:20:40.257582 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.257543    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:40.318374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.318344    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:40.324218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.324193    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.327941 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.327896    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 19 01:20:40.328076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.327975    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 19 01:20:40.328201 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.328184    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-v6j6j\""
Sep 19 01:20:40.328451 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.328426    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 19 01:20:40.342173 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.342150    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:40.378316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.378279    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:40.432339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.432313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.432443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.432348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.432443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.432368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8hnd\" (UniqueName: \"kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.508188 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.508119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:40.533692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.533665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.533810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.533709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.533810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.533734    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8hnd\" (UniqueName: \"kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.536085 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.536060    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.536196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.536144    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.553843 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.553823    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8hnd\" (UniqueName: \"kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd\") pod \"maas-controller-b7fb6b9f7-l7nhw\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") " pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.635182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.635155    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:40.755340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.755312    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:40.914077 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:40.914050    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:40.917700 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:20:40.917668    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a44ad8d_bb5b_4794_9e62_2afdd7f7e2af.slice/crio-f2cfcfd752e8d7b791c2f4f25049169b4f86b3c6131ef8035e4ffc89db8e8c62 WatchSource:0}: Error finding container f2cfcfd752e8d7b791c2f4f25049169b4f86b3c6131ef8035e4ffc89db8e8c62: Status 404 returned error can't find the container with id f2cfcfd752e8d7b791c2f4f25049169b4f86b3c6131ef8035e4ffc89db8e8c62
Sep 19 01:20:41.248054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:41.247980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" event={"ID":"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af","Type":"ContainerStarted","Data":"f2cfcfd752e8d7b791c2f4f25049169b4f86b3c6131ef8035e4ffc89db8e8c62"}
Sep 19 01:20:43.604154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:43.604123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:43.705555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:43.705476    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:20:44.262792 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:44.262756    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" event={"ID":"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af","Type":"ContainerStarted","Data":"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"}
Sep 19 01:20:44.263006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:44.262901    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:44.307637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:44.307592    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" podStartSLOduration=1.804315365 podStartE2EDuration="4.307577596s" totalImagesPullingTime="2.503262231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:20:44.303467736 +0000 UTC m=+491.644915671" watchObservedRunningTime="2026-09-19 01:20:44.307577596 +0000 UTC m=+491.649025519"
Sep 19 01:20:54.952196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:54.952165    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:54.952632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:54.952341    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" podUID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" containerName="manager" containerID="cri-o://6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5" gracePeriod=30
Sep 19 01:20:54.954042 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:54.954018    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:55.188041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.188016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:55.309845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.309817    2567 generic.go:356] "Generic (PLEG): container finished" podID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" containerID="6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5" exitCode=0
Sep 19 01:20:55.310011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.309856    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw"
Sep 19 01:20:55.310011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.309865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" event={"ID":"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af","Type":"ContainerDied","Data":"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"}
Sep 19 01:20:55.310011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.309904    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-b7fb6b9f7-l7nhw" event={"ID":"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af","Type":"ContainerDied","Data":"f2cfcfd752e8d7b791c2f4f25049169b4f86b3c6131ef8035e4ffc89db8e8c62"}
Sep 19 01:20:55.310011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.309945    2567 scope.go:117] "RemoveContainer" containerID="6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"
Sep 19 01:20:55.317901 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.317886    2567 scope.go:117] "RemoveContainer" containerID="6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"
Sep 19 01:20:55.318209 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:20:55.318191    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5\": container with ID starting with 6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5 not found: ID does not exist" containerID="6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"
Sep 19 01:20:55.318261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.318218    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5"} err="failed to get container status \"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5\": rpc error: code = NotFound desc = could not find container \"6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5\": container with ID starting with 6ba75332f0203933c0acbbda18a47e8306659d280731e1f25e64aa8bc51082f5 not found: ID does not exist"
Sep 19 01:20:55.359551 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.359530    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs\") pod \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") "
Sep 19 01:20:55.359653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.359577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8hnd\" (UniqueName: \"kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd\") pod \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") "
Sep 19 01:20:55.359653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.359596    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert\") pod \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\" (UID: \"8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af\") "
Sep 19 01:20:55.361690 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.361667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd" (OuterVolumeSpecName: "kube-api-access-l8hnd") pod "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" (UID: "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af"). InnerVolumeSpecName "kube-api-access-l8hnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:20:55.361690 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.361677    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" (UID: "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:20:55.361804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.361685    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" (UID: "8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:20:55.460859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.460824    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8hnd\" (UniqueName: \"kubernetes.io/projected/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-kube-api-access-l8hnd\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:20:55.460859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.460857    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-webhook-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:20:55.460859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.460866    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:20:55.633031 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.633006    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:55.636848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:55.636825    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-b7fb6b9f7-l7nhw"]
Sep 19 01:20:56.920810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:20:56.920767    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" path="/var/lib/kubelet/pods/8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af/volumes"
Sep 19 01:21:02.692375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:02.692335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:10.355837 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:10.355798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:15.275297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:15.275260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:15.374501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:15.374469    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:16.895538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:16.895457    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:16.995077 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:16.995044    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:17.024606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.024578    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:21:17.024995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.024978    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" containerName="manager"
Sep 19 01:21:17.025096 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.024996    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" containerName="manager"
Sep 19 01:21:17.025158 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.025120    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a44ad8d-bb5b-4794-9e62-2afdd7f7e2af" containerName="manager"
Sep 19 01:21:17.031342 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.031323    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.037295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.037270    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 01:21:17.037474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.037449    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 01:21:17.037898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.037684    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8d4ph\""
Sep 19 01:21:17.037898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.037881    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 01:21:17.045756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.045736    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 01:21:17.065153 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.065132    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:21:17.133013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.132986    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.133013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.133015    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.133256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.133047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.133256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.133159    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.234448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.234374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.234448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.234433    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.234672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.234459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.234672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.234499    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.235125 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.235104    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.236936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.236890    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.236936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.236907    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.240419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.240394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:17.268123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.268106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q\") pod \"maas-api-5598d8c9fb-mrfcz\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") " pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.341795 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.341769    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:17.424891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.424859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:17.624766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.624727    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:21:17.626578 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:21:17.626552    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod912ff3dc_2fb6_4ed1_ad50_dd2315325ca5.slice/crio-10b95258f18f0c11b02da1711f452fe3017740ce3553cfa5a22d639d1ec9fe76 WatchSource:0}: Error finding container 10b95258f18f0c11b02da1711f452fe3017740ce3553cfa5a22d639d1ec9fe76: Status 404 returned error can't find the container with id 10b95258f18f0c11b02da1711f452fe3017740ce3553cfa5a22d639d1ec9fe76
Sep 19 01:21:17.875056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:17.874966    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:18.025515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:18.025472    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:18.413573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:18.413535    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" event={"ID":"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5","Type":"ContainerStarted","Data":"10b95258f18f0c11b02da1711f452fe3017740ce3553cfa5a22d639d1ec9fe76"}
Sep 19 01:21:20.433516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:20.433480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" event={"ID":"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5","Type":"ContainerStarted","Data":"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"}
Sep 19 01:21:20.433895 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:20.433615    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:20.453753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:20.453710    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" podStartSLOduration=2.586791144 podStartE2EDuration="4.453696981s" totalImagesPullingTime="1.866905837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:21:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:21:20.45218654 +0000 UTC m=+527.793634464" watchObservedRunningTime="2026-09-19 01:21:20.453696981 +0000 UTC m=+527.795144903"
Sep 19 01:21:26.444573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:26.444543    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:21:27.450483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:27.450443    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:27.545455 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:27.545432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:28.055789 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.055754    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:28.055969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.055818    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:28.217787 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.217758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:28.472333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.472248    2567 generic.go:356] "Generic (PLEG): container finished" podID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerID="f56c4aa2ec3cad234a264f038c846b02a916c934aea73e3e57e3f842e634022d" exitCode=0
Sep 19 01:21:28.472333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.472303    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" event={"ID":"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8","Type":"ContainerDied","Data":"f56c4aa2ec3cad234a264f038c846b02a916c934aea73e3e57e3f842e634022d"}
Sep 19 01:21:28.472834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.472745    2567 scope.go:117] "RemoveContainer" containerID="f56c4aa2ec3cad234a264f038c846b02a916c934aea73e3e57e3f842e634022d"
Sep 19 01:21:28.473744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.473716    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:21:28.473805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.473783    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:21:28.473841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:28.473816    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:21:29.478560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:29.478524    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" event={"ID":"69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8","Type":"ContainerStarted","Data":"b92bf36e7251a433073b6d871893b2b0eddf07412be368eed74fee1d22d532d6"}
Sep 19 01:21:30.469729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:30.469696    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:21:30.469930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:30.469889    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:30.470007 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:30.469956    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:31.469905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:31.469873    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:31.470301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:31.469958    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:32.469998 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:32.469964    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:32.470397 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:32.470057    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:33.470748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:33.470708    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:33.471145 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:33.470771    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:34.469832 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:34.469798    2567 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-ks4rw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 19 01:21:34.470122 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:34.469854    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw" podUID="69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 19 01:21:35.473741 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:35.473711    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:21:35.474212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:35.474190    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:21:35.474779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:35.474765    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-ks4rw"
Sep 19 01:21:36.696221 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.696187    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"]
Sep 19 01:21:36.702910 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.702880    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.705596 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.705576    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 01:21:36.705831 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.705806    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 01:21:36.705962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.705862    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 19 01:21:36.705962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.705862    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-z77ck\""
Sep 19 01:21:36.709314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.709291    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"]
Sep 19 01:21:36.725551 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.725526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:36.815371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815343    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.815371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815375    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.815605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b6gs\" (UniqueName: \"kubernetes.io/projected/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-kube-api-access-6b6gs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.815605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.815605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.815605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.815600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916671    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b6gs\" (UniqueName: \"kubernetes.io/projected/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-kube-api-access-6b6gs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.916947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.916800    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.917245 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.917166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.917294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.917260    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.917294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.917269    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.919346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.919313    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.919447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.919409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:36.926087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:36.926066    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b6gs\" (UniqueName: \"kubernetes.io/projected/19bcba77-e2ec-454b-a0d3-c375c5a7dc0e-kube-api-access-6b6gs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg\" (UID: \"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:37.015273 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:37.015202    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:37.288992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:37.288944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"]
Sep 19 01:21:37.290597 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:21:37.290573    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19bcba77_e2ec_454b_a0d3_c375c5a7dc0e.slice/crio-154482b905275c5b8209f0d3ee0422731dc00157001a01f3a832fd72583552ce WatchSource:0}: Error finding container 154482b905275c5b8209f0d3ee0422731dc00157001a01f3a832fd72583552ce: Status 404 returned error can't find the container with id 154482b905275c5b8209f0d3ee0422731dc00157001a01f3a832fd72583552ce
Sep 19 01:21:37.521261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:37.521191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg" event={"ID":"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e","Type":"ContainerStarted","Data":"154482b905275c5b8209f0d3ee0422731dc00157001a01f3a832fd72583552ce"}
Sep 19 01:21:38.527215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:38.527173    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg" event={"ID":"19bcba77-e2ec-454b-a0d3-c375c5a7dc0e","Type":"ContainerStarted","Data":"92e87b8a8a7fca9361c10e643b0709fdb580dd4abde413fc8a63e67df003db24"}
Sep 19 01:21:38.547048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:38.546999    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg" podStartSLOduration=1.458114635 podStartE2EDuration="2.546984586s" totalImagesPullingTime="1.088869951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:21:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:21:38.545841387 +0000 UTC m=+545.887289307" watchObservedRunningTime="2026-09-19 01:21:38.546984586 +0000 UTC m=+545.888432523"
Sep 19 01:21:47.015669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:47.015639    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:47.016078 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:47.015703    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:47.028060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:47.028033    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:47.028954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:47.028902    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:47.578323 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:47.578296    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg"
Sep 19 01:21:52.098090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.098060    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"]
Sep 19 01:21:52.101473 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.101454    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.104223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.104204    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 19 01:21:52.123543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.123522    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"]
Sep 19 01:21:52.205302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.205271    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:21:52.248176 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248151    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdln4\" (UniqueName: \"kubernetes.io/projected/fd4e8b20-da36-4d5a-83cb-4bc11024aece-kube-api-access-gdln4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.248310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.248310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.248310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.248459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.248459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.248410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349512    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdln4\" (UniqueName: \"kubernetes.io/projected/fd4e8b20-da36-4d5a-83cb-4bc11024aece-kube-api-access-gdln4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349599    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349662    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.349862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.349700    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.350095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.350067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.350179 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.350119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.350237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.350191    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.351958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.351937    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd4e8b20-da36-4d5a-83cb-4bc11024aece-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.352220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.352204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd4e8b20-da36-4d5a-83cb-4bc11024aece-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.359025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.358994    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdln4\" (UniqueName: \"kubernetes.io/projected/fd4e8b20-da36-4d5a-83cb-4bc11024aece-kube-api-access-gdln4\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf\" (UID: \"fd4e8b20-da36-4d5a-83cb-4bc11024aece\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.410948 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.410925    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:21:52.687182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:52.687154    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"]
Sep 19 01:21:52.688647 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:21:52.688622    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4e8b20_da36_4d5a_83cb_4bc11024aece.slice/crio-25195c585570f13259e1492110c20954e5715293831ab785e4e3f1b7939d322f WatchSource:0}: Error finding container 25195c585570f13259e1492110c20954e5715293831ab785e4e3f1b7939d322f: Status 404 returned error can't find the container with id 25195c585570f13259e1492110c20954e5715293831ab785e4e3f1b7939d322f
Sep 19 01:21:53.596698 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:53.596654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf" event={"ID":"fd4e8b20-da36-4d5a-83cb-4bc11024aece","Type":"ContainerStarted","Data":"c905d84d04b103c34e631843111ea8e1714eaa5cbc063230379eed5f243fab93"}
Sep 19 01:21:53.597138 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:53.596723    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf" event={"ID":"fd4e8b20-da36-4d5a-83cb-4bc11024aece","Type":"ContainerStarted","Data":"25195c585570f13259e1492110c20954e5715293831ab785e4e3f1b7939d322f"}
Sep 19 01:21:53.619356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:21:53.619311    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf" podStartSLOduration=1.445314926 podStartE2EDuration="1.619296411s" totalImagesPullingTime="173.981485ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:21:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:21:53.618205057 +0000 UTC m=+560.959652981" watchObservedRunningTime="2026-09-19 01:21:53.619296411 +0000 UTC m=+560.960744333"
Sep 19 01:22:02.411140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:02.411104    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:22:02.411619 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:02.411168    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:22:02.423476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:02.423449    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:22:02.648785 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:02.648755    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf"
Sep 19 01:22:08.478260 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:08.478225    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:08.547359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:08.547322    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:18.887934 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:18.887883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:26.991340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:26.991298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:34.878185 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:34.878158    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:22:34.879632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:34.879613    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:22:36.201706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.201674    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"]
Sep 19 01:22:36.205636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.205613    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.208395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.208372    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 19 01:22:36.220525 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.220500    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"]
Sep 19 01:22:36.237381 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.237346    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:36.328216 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328181    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.328364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328272    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.328364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.328470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.328470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.328547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.328498    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rc79\" (UniqueName: \"kubernetes.io/projected/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-kube-api-access-8rc79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.428937 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.428891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.428949    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.428981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429007    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rc79\" (UniqueName: \"kubernetes.io/projected/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-kube-api-access-8rc79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429438 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429423    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.429514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.429473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.431275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.431254    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.431500 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.431480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.436353 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.436332    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rc79\" (UniqueName: \"kubernetes.io/projected/11cd11e0-5bdb-4bb4-a8c8-34e7726d5923-kube-api-access-8rc79\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5\" (UID: \"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.516248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.516187    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:36.790203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:36.790177    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"]
Sep 19 01:22:36.791691 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:22:36.791661    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11cd11e0_5bdb_4bb4_a8c8_34e7726d5923.slice/crio-7b6a410cbf9b69ecc27bea2faf31461145fa5cdf90730e0e4fe27eb69af317bc WatchSource:0}: Error finding container 7b6a410cbf9b69ecc27bea2faf31461145fa5cdf90730e0e4fe27eb69af317bc: Status 404 returned error can't find the container with id 7b6a410cbf9b69ecc27bea2faf31461145fa5cdf90730e0e4fe27eb69af317bc
Sep 19 01:22:37.798993 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:37.798958    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5" event={"ID":"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923","Type":"ContainerStarted","Data":"34b970f5a9a3fdeca6193383831b1f4930d305d234386b486a0addd9c25689c1"}
Sep 19 01:22:37.799392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:37.799008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5" event={"ID":"11cd11e0-5bdb-4bb4-a8c8-34e7726d5923","Type":"ContainerStarted","Data":"7b6a410cbf9b69ecc27bea2faf31461145fa5cdf90730e0e4fe27eb69af317bc"}
Sep 19 01:22:37.830291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:37.830239    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5" podStartSLOduration=1.670626823 podStartE2EDuration="1.830224025s" totalImagesPullingTime="159.597202ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:22:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:22:37.828375089 +0000 UTC m=+605.169823013" watchObservedRunningTime="2026-09-19 01:22:37.830224025 +0000 UTC m=+605.171671948"
Sep 19 01:22:42.273410 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:42.273374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:22:46.517101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:46.517066    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:46.517596 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:46.517125    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:46.529347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:46.529320    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:46.854512 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:46.854477    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5"
Sep 19 01:22:55.319533 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:22:55.319498    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:23:30.264487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:23:30.264444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:23:30.343681 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:23:30.343652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:19.843968 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:19.843867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:31.633781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:31.633745    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:53.056093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:53.056052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:53.153135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:53.153089    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:54.260110 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:54.260074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:24:54.347814 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:24:54.347787    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.337143 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.337094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.429581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.429546    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.537317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.537283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.675317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.675244    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:25:10.678688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.678666    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.681661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.681642    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-8e708f-openshift-default-dockercfg-lnhh8\""
Sep 19 01:25:10.697006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.696985    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:25:10.707952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.707909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.817041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817011    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817204 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817204 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817123    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817211    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817308    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817363    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817451 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817399    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.817451 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.817439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrzxd\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.826965 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.826939    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.857317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.857289    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:25:10.860817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.860796    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:10.864343 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.864320    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-b3b22c-openshift-default-dockercfg-5jj5w\""
Sep 19 01:25:10.873240 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.873221    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:25:10.917996 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.917976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918017    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918058    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrzxd\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918118    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918155    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918224    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918297    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918464    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918626    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.918840 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.918791    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.919309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.919270    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.921151 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.921128    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.921267 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.921199    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.925241 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.925158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:10.927293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.927246    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.927425 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.927408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrzxd\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd\") pod \"e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") " pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:10.989559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:10.989526    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019339    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019542    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019577    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fnwd\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.020341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.019726    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.037261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.037220    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:11.121207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121290    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fnwd\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121347    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121371    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121420    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121491    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.121989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.121960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.122197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.122176    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.122277 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.122205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.122449 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.122415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.122969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.122941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.124546 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.124525    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.125108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.125084    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.136286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.136266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.137115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.137091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fnwd\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd\") pod \"e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") " pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.173421 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.173400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:11.193894 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.193846    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:11.296802 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.296776    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:25:11.298357 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:11.298330    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711dc6d1_46f4_4923_8a8d_70d33d6f1a6d.slice/crio-419bf2f41dce323ab3e2090086a134d2cf649d556a67da10eec34dc6a8373ca7 WatchSource:0}: Error finding container 419bf2f41dce323ab3e2090086a134d2cf649d556a67da10eec34dc6a8373ca7: Status 404 returned error can't find the container with id 419bf2f41dce323ab3e2090086a134d2cf649d556a67da10eec34dc6a8373ca7
Sep 19 01:25:11.300636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.300595    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.300722 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.300683    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.300766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.300729    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.324263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.324223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:11.454416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.454385    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:25:11.456269 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:11.456237    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod079963b3_11cd_449a_b5bc_88533144c1eb.slice/crio-899ef17352bb8dca42ceab3acca1ab077b9a644b1ded15b61a3a46865046d777 WatchSource:0}: Error finding container 899ef17352bb8dca42ceab3acca1ab077b9a644b1ded15b61a3a46865046d777: Status 404 returned error can't find the container with id 899ef17352bb8dca42ceab3acca1ab077b9a644b1ded15b61a3a46865046d777
Sep 19 01:25:11.458665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.458633    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.458753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.458709    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.458819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.458752    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:11.514212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.514162    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerStarted","Data":"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"}
Sep 19 01:25:11.514406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.514383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerStarted","Data":"419bf2f41dce323ab3e2090086a134d2cf649d556a67da10eec34dc6a8373ca7"}
Sep 19 01:25:11.516666 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.516647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerStarted","Data":"899ef17352bb8dca42ceab3acca1ab077b9a644b1ded15b61a3a46865046d777"}
Sep 19 01:25:11.541166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.541122    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podStartSLOduration=1.5411067859999998 podStartE2EDuration="1.541106786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:11.538248926 +0000 UTC m=+758.879696852" watchObservedRunningTime="2026-09-19 01:25:11.541106786 +0000 UTC m=+758.882554708"
Sep 19 01:25:11.942120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.942081    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:11.989831 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:11.989803    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:12.046633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:12.046606    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:12.389578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:12.389547    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:12.523379 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:12.523346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerStarted","Data":"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"}
Sep 19 01:25:12.553838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:12.553792    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podStartSLOduration=2.5537761469999998 podStartE2EDuration="2.553776147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:12.552829917 +0000 UTC m=+759.894277868" watchObservedRunningTime="2026-09-19 01:25:12.553776147 +0000 UTC m=+759.895224069"
Sep 19 01:25:12.994510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:12.994481    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:13.174492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.174461    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:13.179348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.179323    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:13.528307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.528267    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:13.528745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.528511    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:13.529292 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.529270    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:13.529420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.529384    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:13.638164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.638117    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:13.747076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:13.747045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:14.987966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:14.987874    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:15.105660 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:15.105626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:15.206010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:15.205974    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:15.733790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:15.733731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:15.883825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:15.883791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:16.142538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.142501    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:16.514886 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.514806    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:25:16.520128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.520094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.524781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.524758    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-b3b22c-serving-cert\""
Sep 19 01:25:16.533361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.533336    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:25:16.577313 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.577270    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:16.581213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.581189    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.581319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.581240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.581319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.581276    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgftq\" (UniqueName: \"kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.581442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.581318    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.682344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.682315    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.682498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.682376    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.682498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.682422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgftq\" (UniqueName: \"kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.682698 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.682504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.682698 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:16.682615    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-serving-cert: secret "maas-api-e2e-worker-w4-b3b22c-serving-cert" not found
Sep 19 01:25:16.682698 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:16.682686    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls podName:c7bf7151-0ee5-4563-a2fd-19aaee62a3ce nodeName:}" failed. No retries permitted until 2026-09-19 01:25:17.182665625 +0000 UTC m=+764.524113530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls") pod "maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" (UID: "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce") : secret "maas-api-e2e-worker-w4-b3b22c-serving-cert" not found
Sep 19 01:25:16.683041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.683022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.684983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.684962    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.697028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.697005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgftq\" (UniqueName: \"kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:16.724510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.724481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:16.997198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:16.997159    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:17.186483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.186451    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:17.188814 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.188795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") pod \"maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:17.440048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.440020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:17.452508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.452439    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:17.551019 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.550896    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:17.718823 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.718342    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:25:17.723680 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:17.723643    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7bf7151_0ee5_4563_a2fd_19aaee62a3ce.slice/crio-a9953459788c4b3ec572e8cd10390aca34470ae0a3e51d11adbb22609dc08cbe WatchSource:0}: Error finding container a9953459788c4b3ec572e8cd10390aca34470ae0a3e51d11adbb22609dc08cbe: Status 404 returned error can't find the container with id a9953459788c4b3ec572e8cd10390aca34470ae0a3e51d11adbb22609dc08cbe
Sep 19 01:25:17.726395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:17.726372    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 01:25:18.035856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.035812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:18.148315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.148281    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:18.562151 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.562117    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" event={"ID":"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce","Type":"ContainerStarted","Data":"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"}
Sep 19 01:25:18.562514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.562175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" event={"ID":"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce","Type":"ContainerStarted","Data":"a9953459788c4b3ec572e8cd10390aca34470ae0a3e51d11adbb22609dc08cbe"}
Sep 19 01:25:18.562514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.562264    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:18.588706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:18.588653    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" podStartSLOduration=2.109734782 podStartE2EDuration="2.588640998s" totalImagesPullingTime="478.906216ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:18.587149303 +0000 UTC m=+765.928597227" watchObservedRunningTime="2026-09-19 01:25:18.588640998 +0000 UTC m=+765.930088921"
Sep 19 01:25:19.239964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:19.239901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:19.926991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:19.926954    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:20.097757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.097718    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:20.231368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.231264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:20.565143 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.565105    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:20.569344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.569321    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.574386 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.574363    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a6519132-openshift-default-dockercfg-zrxwv\""
Sep 19 01:25:20.582592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.582567    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:20.602207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.602184    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:20.615456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615591 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615590    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615658    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615683    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615811 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z82dz\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.615844 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.615820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.693443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.693406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:20.716955 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.716937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717064 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.716961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717064 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.716981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z82dz\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717064 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717091    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717254    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717286    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717605    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717655    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717782    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.717886 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.717865    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.719512 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.719495    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.719597 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.719545    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.735079 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.735051    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.736558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.736533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z82dz\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz\") pod \"e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") " pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:20.885009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:20.884904    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:21.018376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.018335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:21.163392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.163365    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:21.164640 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:21.164615    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93bc4f90_ca3b_4951_9986_0122fdd81137.slice/crio-3aa115243bd7c9fe99afb7ebf6bae08f0fd447cdf67aa945c38789b0045dc3e1 WatchSource:0}: Error finding container 3aa115243bd7c9fe99afb7ebf6bae08f0fd447cdf67aa945c38789b0045dc3e1: Status 404 returned error can't find the container with id 3aa115243bd7c9fe99afb7ebf6bae08f0fd447cdf67aa945c38789b0045dc3e1
Sep 19 01:25:21.166880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.166845    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:21.167028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.166907    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:21.167028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.166963    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:21.579235 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.579192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerStarted","Data":"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"}
Sep 19 01:25:21.579436 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.579255    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerStarted","Data":"3aa115243bd7c9fe99afb7ebf6bae08f0fd447cdf67aa945c38789b0045dc3e1"}
Sep 19 01:25:21.631538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.631498    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podStartSLOduration=1.631482793 podStartE2EDuration="1.631482793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:21.631468788 +0000 UTC m=+768.972916710" watchObservedRunningTime="2026-09-19 01:25:21.631482793 +0000 UTC m=+768.972930716"
Sep 19 01:25:21.885206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.885113    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:21.921954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.921892    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:25:21.928037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.928003    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:21.934539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.934518    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c4ce82-serving-cert\""
Sep 19 01:25:21.941060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.941038    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:25:21.957366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:21.957337    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:22.029552 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.029520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.029975 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.029569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvlqn\" (UniqueName: \"kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.029975 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.029670    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.029975 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.029714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.055629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.055600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:22.130669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.130644    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.130790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.130674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.130790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.130751    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.130790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.130780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvlqn\" (UniqueName: \"kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.131439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.131419    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.133125 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.133106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.133192 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.133161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.146281 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.146232    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvlqn\" (UniqueName: \"kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn\") pod \"maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.170632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.170592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:22.241796 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.241764    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:22.533228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.533203    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:25:22.533966 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:22.533937    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5244d18a_1cca_4efc_9d7d_4122e1923188.slice/crio-8b5f45fbc8f510371e81960f2e905c82391caaba37d519a673a7740e6ae00e5a WatchSource:0}: Error finding container 8b5f45fbc8f510371e81960f2e905c82391caaba37d519a673a7740e6ae00e5a: Status 404 returned error can't find the container with id 8b5f45fbc8f510371e81960f2e905c82391caaba37d519a673a7740e6ae00e5a
Sep 19 01:25:22.584542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.584510    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" event={"ID":"5244d18a-1cca-4efc-9d7d-4122e1923188","Type":"ContainerStarted","Data":"8b5f45fbc8f510371e81960f2e905c82391caaba37d519a673a7740e6ae00e5a"}
Sep 19 01:25:22.890129 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.890049    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:22.899163 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:22.899133    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:23.082816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.082782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:23.263316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.263222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:23.370609 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.370540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:23.590807 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.590762    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" event={"ID":"5244d18a-1cca-4efc-9d7d-4122e1923188","Type":"ContainerStarted","Data":"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"}
Sep 19 01:25:23.591068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.591043    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:23.591213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.591186    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:23.592184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.592167    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:23.633229 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.633172    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" podStartSLOduration=2.219357323 podStartE2EDuration="2.633154809s" totalImagesPullingTime="413.797486ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:23.623074498 +0000 UTC m=+770.964522421" watchObservedRunningTime="2026-09-19 01:25:23.633154809 +0000 UTC m=+770.974602731"
Sep 19 01:25:23.835821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:23.835770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:24.571653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:24.571627    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:25:25.018996 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.018620    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:25.037160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.035507    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:25.037160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.035625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.039085 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.039048    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a6519132-serving-cert\""
Sep 19 01:25:25.055590 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.055562    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:25.060123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.060100    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68k24\" (UniqueName: \"kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.060211 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.060163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.060293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.060271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.060345 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.060329    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.156553 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.156516    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:25.161644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.161617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68k24\" (UniqueName: \"kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.161828 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.161674    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.161828 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.161725    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.161828 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.161758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.162023 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:25.161950    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-serving-cert: secret "maas-api-e2e-ait-a6519132-serving-cert" not found
Sep 19 01:25:25.162023 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:25.162012    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls podName:337cbcba-19ad-4dcb-b2f5-9c95fc59fc41 nodeName:}" failed. No retries permitted until 2026-09-19 01:25:25.661993091 +0000 UTC m=+773.003440993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls") pod "maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" (UID: "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41") : secret "maas-api-e2e-ait-a6519132-serving-cert" not found
Sep 19 01:25:25.162597 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.162570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.164470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.164446    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.179997 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.179974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68k24\" (UniqueName: \"kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.388929 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.388878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:25.667332 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.667238    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.669693 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.669665    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") pod \"maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:25.924289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.924175    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:25.947885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:25.947861    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:26.036647 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:26.035750    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:26.243414 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:26.243390    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:26.245184 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:26.245157    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337cbcba_19ad_4dcb_b2f5_9c95fc59fc41.slice/crio-819f9afe83eb123413c4fb1f068ff5cca03e4b51ad6acba3968bf5832d84d4c0 WatchSource:0}: Error finding container 819f9afe83eb123413c4fb1f068ff5cca03e4b51ad6acba3968bf5832d84d4c0: Status 404 returned error can't find the container with id 819f9afe83eb123413c4fb1f068ff5cca03e4b51ad6acba3968bf5832d84d4c0
Sep 19 01:25:26.417834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:26.417791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:26.612154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:26.612108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" event={"ID":"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41","Type":"ContainerStarted","Data":"819f9afe83eb123413c4fb1f068ff5cca03e4b51ad6acba3968bf5832d84d4c0"}
Sep 19 01:25:26.682080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:26.682047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:27.026373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.026287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:27.155473 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.155419    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:27.422866 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.422827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:27.625697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.625661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" event={"ID":"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41","Type":"ContainerStarted","Data":"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"}
Sep 19 01:25:27.625887 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.625772    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:27.646643 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:27.646591    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" podStartSLOduration=3.2507070000000002 podStartE2EDuration="3.646578923s" totalImagesPullingTime="395.871923ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:27.645327045 +0000 UTC m=+774.986774970" watchObservedRunningTime="2026-09-19 01:25:27.646578923 +0000 UTC m=+774.988026845"
Sep 19 01:25:28.543601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:28.543511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:29.359814 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:29.359778    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:29.612187 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:29.612093    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:25:30.348620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:30.348585    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:31.208606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:31.208568    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:31.377375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:31.377333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:31.473194 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:31.473111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:31.570269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:31.570233    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:32.433475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:32.433443    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:33.516727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:33.516613    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:33.648212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:33.648175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:33.864942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:33.864872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:34.211461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.211345    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:34.452869 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.452830    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:34.598841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.598662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:34.691477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.691444    2567 generic.go:356] "Generic (PLEG): container finished" podID="079963b3-11cd-449a-b5bc-88533144c1eb" containerID="233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9" exitCode=0
Sep 19 01:25:34.691645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.691508    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerDied","Data":"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"}
Sep 19 01:25:34.692021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.692000    2567 scope.go:117] "RemoveContainer" containerID="233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"
Sep 19 01:25:34.693225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.693194    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:34.693301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.693275    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:34.693337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:34.693312    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:35.065511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:35.065464    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:35.164297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:35.164259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:35.290503 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:35.290445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:35.638717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:35.638676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:35.708144 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:35.708103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerStarted","Data":"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"}
Sep 19 01:25:36.173754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.173718    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:36.173972 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.173947    2567 patch_prober.go:28] interesting pod/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 19 01:25:36.174040 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.174013    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 19 01:25:36.291600 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.291563    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:36.714943 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.711620    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:25:36.736939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.736414    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:25:36.736939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.736523    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.772463 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.771343    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-44f561-serving-cert\""
Sep 19 01:25:36.773304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.773280    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:36.843755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.842562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wjx\" (UniqueName: \"kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.843755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.842660    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.843755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.842727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.843755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.842793    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.865949 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.856419    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:36.944936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.944260    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wjx\" (UniqueName: \"kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.944936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.944323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.944936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.944369    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.944936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.944421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.945302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.945250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.946071 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:36.946047    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-44f561-serving-cert: secret "maas-api-e2e-autores-44f561-serving-cert" not found
Sep 19 01:25:36.946197 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:36.946141    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls podName:3328f79a-4687-433a-a5bb-dd8ac36b9665 nodeName:}" failed. No retries permitted until 2026-09-19 01:25:37.446120527 +0000 UTC m=+784.787568439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls") pod "maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" (UID: "3328f79a-4687-433a-a5bb-dd8ac36b9665") : secret "maas-api-e2e-autores-44f561-serving-cert" not found
Sep 19 01:25:36.953936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.949541    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:36.957348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:36.957330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wjx\" (UniqueName: \"kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:37.064180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.064149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:37.173992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.173832    2567 patch_prober.go:28] interesting pod/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 19 01:25:37.173992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.173899    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 19 01:25:37.381392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.381314    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:37.456203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.455561    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:37.462550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.462514    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") pod \"maas-api-e2e-autores-44f561-5cf67bc496-ncs5d\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:37.484823 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.484798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:37.683309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.683211    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:37.855974 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.855478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:37.994185 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:37.994095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:38.076251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.075769    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:25:38.076608 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:38.076588    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3328f79a_4687_433a_a5bb_dd8ac36b9665.slice/crio-001103c29f3e4e9719cd6fd33ddf381390d76e9777e5ba2a2e2d841e03b87e8d WatchSource:0}: Error finding container 001103c29f3e4e9719cd6fd33ddf381390d76e9777e5ba2a2e2d841e03b87e8d: Status 404 returned error can't find the container with id 001103c29f3e4e9719cd6fd33ddf381390d76e9777e5ba2a2e2d841e03b87e8d
Sep 19 01:25:38.174794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.174754    2567 patch_prober.go:28] interesting pod/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 19 01:25:38.174992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.174820    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 19 01:25:38.392610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.392577    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:38.669241 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.669206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:38.753735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.753698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" event={"ID":"3328f79a-4687-433a-a5bb-dd8ac36b9665","Type":"ContainerStarted","Data":"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"}
Sep 19 01:25:38.753899 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.753761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" event={"ID":"3328f79a-4687-433a-a5bb-dd8ac36b9665","Type":"ContainerStarted","Data":"001103c29f3e4e9719cd6fd33ddf381390d76e9777e5ba2a2e2d841e03b87e8d"}
Sep 19 01:25:38.753995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.753901    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:38.773282 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:38.773227    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" podStartSLOduration=2.487726022 podStartE2EDuration="2.773209207s" totalImagesPullingTime="285.483185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:38.772441752 +0000 UTC m=+786.113889676" watchObservedRunningTime="2026-09-19 01:25:38.773209207 +0000 UTC m=+786.114657132"
Sep 19 01:25:39.148252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.148211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:39.174147 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.174105    2567 patch_prober.go:28] interesting pod/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 19 01:25:39.174338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.174165    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 19 01:25:39.281388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.281344    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:39.633116 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.633062    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 01:25:39.633353 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.633156    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 01:25:39.760988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.760956    2567 generic.go:356] "Generic (PLEG): container finished" podID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerID="58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea" exitCode=0
Sep 19 01:25:39.761175 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.761034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerDied","Data":"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"}
Sep 19 01:25:39.761539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.761521    2567 scope.go:117] "RemoveContainer" containerID="58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"
Sep 19 01:25:39.762819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.762788    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:39.762904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.762877    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:39.762980 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:39.762910    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:40.174751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.174714    2567 patch_prober.go:28] interesting pod/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 19 01:25:40.175402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.174770    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 19 01:25:40.208464 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.208422    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:40.422532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.422445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:40.660687 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.660646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:40.769307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.768603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerStarted","Data":"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"}
Sep 19 01:25:40.990081 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.989985    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:40.991352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.991317    2567 patch_prober.go:28] interesting pod/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 19 01:25:40.991475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:40.991376    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 19 01:25:41.178330 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.178305    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:41.178755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.178695    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:41.179481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.179464    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:25:41.981304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.981265    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:41.990017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.989989    2567 patch_prober.go:28] interesting pod/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 19 01:25:41.990199 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:41.990036    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 19 01:25:42.662065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.661994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:42.779595 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.779565    2567 generic.go:356] "Generic (PLEG): container finished" podID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerID="485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c" exitCode=0
Sep 19 01:25:42.779766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.779642    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerDied","Data":"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"}
Sep 19 01:25:42.780162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.780146    2567 scope.go:117] "RemoveContainer" containerID="485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"
Sep 19 01:25:42.781159 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.781134    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:42.781220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.781201    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:42.781257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.781234    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:42.814164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.814123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:42.990205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.990127    2567 patch_prober.go:28] interesting pod/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 19 01:25:42.990348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:42.990193    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 19 01:25:43.489622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.489576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:43.528327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.528292    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:43.787006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.786969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerStarted","Data":"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"}
Sep 19 01:25:43.885517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.885479    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:43.885688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.885531    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:43.885688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.885577    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:43.990697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.990660    2567 patch_prober.go:28] interesting pod/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 19 01:25:43.990856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:43.990713    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 19 01:25:44.766428 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:44.766401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:25:44.885984 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:44.885951    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:44.886549 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:44.886515    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:44.990204 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:44.990164    2567 patch_prober.go:28] interesting pod/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Sep 19 01:25:44.990363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:44.990235    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Sep 19 01:25:45.528811 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:45.528776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:45.885706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:45.885665    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:45.885886 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:45.885736    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:46.075036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:46.074998    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:46.076808 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:46.076786    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:25:46.815382 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:46.815297    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:46.885496 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:46.885465    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:46.885653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:46.885518    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:47.885539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:47.885502    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:47.885951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:47.885561    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:47.960365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:47.960332    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.062250 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.062202    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.308677 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.308594    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.406669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.406636    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.582531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.582456    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.683049 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.683012    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:48.886270 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.886186    2567 patch_prober.go:28] interesting pod/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 19 01:25:48.886270 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:48.886255    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 19 01:25:49.074742 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.074702    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:49.152299 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.152207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:49.302240 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.302188    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:49.392940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.392887    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:49.527475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.527391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:49.889603 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.889570    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:49.889986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.889952    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:49.890537 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:49.890521    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:50.055484 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:50.055447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:50.793280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:50.793246    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:51.627254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:51.627219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.203443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.203412    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:52.203680 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.203641    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" podUID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" containerName="maas-api" containerID="cri-o://681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006" gracePeriod=30
Sep 19 01:25:52.241435 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.241407    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.338789 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.338749    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.436982 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.436951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.448486 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.448468    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:52.529555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.529533    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca\") pod \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") "
Sep 19 01:25:52.529682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.529627    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") pod \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") "
Sep 19 01:25:52.529744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.529729    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68k24\" (UniqueName: \"kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24\") pod \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") "
Sep 19 01:25:52.529784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.529771    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs\") pod \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\" (UID: \"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41\") "
Sep 19 01:25:52.529962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.529908    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" (UID: "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:25:52.531897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.531873    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24" (OuterVolumeSpecName: "kube-api-access-68k24") pod "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" (UID: "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41"). InnerVolumeSpecName "kube-api-access-68k24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:25:52.532007 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.531903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" (UID: "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:25:52.532007 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.531937    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" (UID: "337cbcba-19ad-4dcb-b2f5-9c95fc59fc41"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:25:52.537326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.537294    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.620207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.620177    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:52.629718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.629685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.630882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.630860    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68k24\" (UniqueName: \"kubernetes.io/projected/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-kube-api-access-68k24\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:52.630882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.630880    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:52.631034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.630891    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:52.631034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.630900    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:52.705264 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.705241    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:52.846771 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.846693    2567 generic.go:356] "Generic (PLEG): container finished" podID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" containerID="681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006" exitCode=0
Sep 19 01:25:52.846771 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.846740    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"
Sep 19 01:25:52.846973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.846783    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" event={"ID":"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41","Type":"ContainerDied","Data":"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"}
Sep 19 01:25:52.846973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.846838    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5" event={"ID":"337cbcba-19ad-4dcb-b2f5-9c95fc59fc41","Type":"ContainerDied","Data":"819f9afe83eb123413c4fb1f068ff5cca03e4b51ad6acba3968bf5832d84d4c0"}
Sep 19 01:25:52.846973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.846867    2567 scope.go:117] "RemoveContainer" containerID="681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"
Sep 19 01:25:52.847140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.847093    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy" containerID="cri-o://2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42" gracePeriod=30
Sep 19 01:25:52.856784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.856763    2567 scope.go:117] "RemoveContainer" containerID="681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"
Sep 19 01:25:52.857063 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:52.857042    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006\": container with ID starting with 681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006 not found: ID does not exist" containerID="681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"
Sep 19 01:25:52.857137 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.857075    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006"} err="failed to get container status \"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006\": rpc error: code = NotFound desc = could not find container \"681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006\": container with ID starting with 681c769cddc0934dcd0136b3d83f94e23d1122ec1928befb33f1e39489cb7006 not found: ID does not exist"
Sep 19 01:25:52.890446 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.890422    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:52.895734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.895715    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a6519132-875dbdc6c-4xsq5"]
Sep 19 01:25:52.921042 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:52.921019    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" path="/var/lib/kubelet/pods/337cbcba-19ad-4dcb-b2f5-9c95fc59fc41/volumes"
Sep 19 01:25:53.151432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.151342    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:53.253356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.253324    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:53.394855 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.394828    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:53.551757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.551723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:53.773459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.773425    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:25:53.774048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.774032    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" containerName="maas-api"
Sep 19 01:25:53.774122 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.774050    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" containerName="maas-api"
Sep 19 01:25:53.774177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.774167    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="337cbcba-19ad-4dcb-b2f5-9c95fc59fc41" containerName="maas-api"
Sep 19 01:25:53.778175 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.778154    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.780586 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.780565    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-f7939b7a-gw-openshift-default-dockercfg-kh9dj\""
Sep 19 01:25:53.799075 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.799052    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:25:53.817991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.817909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:53.843126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843232 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843134    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843232 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843288    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nctpx\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843352    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843415    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843443    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.843538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.843467    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nctpx\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944253    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944518    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944637    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944674    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944696    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.944882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.944814    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.945334 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.945288    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.946646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.946622    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.946971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.946955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.954068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.954044    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.954214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.954196    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nctpx\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx\") pod \"e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") " pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:53.974147 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:53.974121    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:54.088365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.088288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:54.372630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.372605    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:25:54.373936 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:25:54.373898    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8fb20b_1720_419a_b205_582ce2374b7a.slice/crio-5e01de7f1111448315ee531e758b509fc4d824469c9864e89cbb989c4d2af271 WatchSource:0}: Error finding container 5e01de7f1111448315ee531e758b509fc4d824469c9864e89cbb989c4d2af271: Status 404 returned error can't find the container with id 5e01de7f1111448315ee531e758b509fc4d824469c9864e89cbb989c4d2af271
Sep 19 01:25:54.376816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.376777    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:54.376887 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.376862    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:54.376948 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.376911    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:25:54.498676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.498644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:54.860905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.860874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerStarted","Data":"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"}
Sep 19 01:25:54.861259 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:54.860939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerStarted","Data":"5e01de7f1111448315ee531e758b509fc4d824469c9864e89cbb989c4d2af271"}
Sep 19 01:25:55.088479 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.088434    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:55.096835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.096804    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:55.135236 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.135076    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podStartSLOduration=2.135055208 podStartE2EDuration="2.135055208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:25:54.887594597 +0000 UTC m=+802.229042521" watchObservedRunningTime="2026-09-19 01:25:55.135055208 +0000 UTC m=+802.476503132"
Sep 19 01:25:55.813879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.813837    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:55.866805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.866771    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:55.867840 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:55.867816    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:25:56.501427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:56.501388    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:56.601120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:56.601084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:56.701427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:56.701391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:56.905398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:56.905367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:57.199676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:57.199591    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:57.376280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:57.376245    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:58.091969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.091943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:58.092670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.092654    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:58.187519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187440    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187472    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187497    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187516    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z82dz\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187562    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187586    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187613    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.187826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187770    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.188057 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187938    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket\") pod \"93bc4f90-ca3b-4951-9986-0122fdd81137\" (UID: \"93bc4f90-ca3b-4951-9986-0122fdd81137\") "
Sep 19 01:25:58.188057 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187769    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data" (OuterVolumeSpecName: "istio-data") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:25:58.188057 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.187951    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:25:58.188202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188123    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:25:58.188285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188264    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:25:58.188504 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188484    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93bc4f90-ca3b-4951-9986-0122fdd81137-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.188585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188510    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.188585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188526    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.188585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188541    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.188758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.188697    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:25:58.189739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.189718    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token" (OuterVolumeSpecName: "istio-token") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:25:58.189838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.189781    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:25:58.189882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.189862    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz" (OuterVolumeSpecName: "kube-api-access-z82dz") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "kube-api-access-z82dz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:25:58.189967 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.189953    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93bc4f90-ca3b-4951-9986-0122fdd81137" (UID: "93bc4f90-ca3b-4951-9986-0122fdd81137"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:25:58.289223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.289193    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.289223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.289220    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.289364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.289230    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z82dz\" (UniqueName: \"kubernetes.io/projected/93bc4f90-ca3b-4951-9986-0122fdd81137-kube-api-access-z82dz\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.289364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.289238    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93bc4f90-ca3b-4951-9986-0122fdd81137-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.289364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.289247    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93bc4f90-ca3b-4951-9986-0122fdd81137-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:25:58.884456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.884419    2567 generic.go:356] "Generic (PLEG): container finished" podID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerID="2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42" exitCode=0
Sep 19 01:25:58.884625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.884468    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"
Sep 19 01:25:58.884625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.884482    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerDied","Data":"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"}
Sep 19 01:25:58.884625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.884529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw" event={"ID":"93bc4f90-ca3b-4951-9986-0122fdd81137","Type":"ContainerDied","Data":"3aa115243bd7c9fe99afb7ebf6bae08f0fd447cdf67aa945c38789b0045dc3e1"}
Sep 19 01:25:58.884625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.884552    2567 scope.go:117] "RemoveContainer" containerID="2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"
Sep 19 01:25:58.893805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.893787    2567 scope.go:117] "RemoveContainer" containerID="485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"
Sep 19 01:25:58.907284 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.907261    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:58.910157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.910138    2567 scope.go:117] "RemoveContainer" containerID="2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"
Sep 19 01:25:58.910454 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:58.910436    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42\": container with ID starting with 2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42 not found: ID does not exist" containerID="2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"
Sep 19 01:25:58.910527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.910461    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42"} err="failed to get container status \"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42\": rpc error: code = NotFound desc = could not find container \"2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42\": container with ID starting with 2f51d532e41c8a8c7f16dbddd3eda9597aa7b2e9f067eaaf7ae9e781385d8a42 not found: ID does not exist"
Sep 19 01:25:58.910527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.910480    2567 scope.go:117] "RemoveContainer" containerID="485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"
Sep 19 01:25:58.910721 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:25:58.910707    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c\": container with ID starting with 485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c not found: ID does not exist" containerID="485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"
Sep 19 01:25:58.910762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.910724    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c"} err="failed to get container status \"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c\": rpc error: code = NotFound desc = could not find container \"485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c\": container with ID starting with 485026e1d988387b946a2a58b43a9f5e3f57e2841092dd7c339693b8589c044c not found: ID does not exist"
Sep 19 01:25:58.912000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.911978    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a6519132-openshift-default-698b7855dd-p4ptw"]
Sep 19 01:25:58.920642 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:58.920620    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" path="/var/lib/kubelet/pods/93bc4f90-ca3b-4951-9986-0122fdd81137/volumes"
Sep 19 01:25:59.030606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.030570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:59.707834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.707801    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:25:59.708434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.708413    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:25:59.708434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.708435    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:25:59.708594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.708551    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:25:59.711503 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.711484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.714123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.714102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-f7939b7a-serving-cert\""
Sep 19 01:25:59.721577 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.721554    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:25:59.748316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.748284    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:59.802601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.802573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfhm\" (UniqueName: \"kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.802716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.802646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.802716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.802705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.802830 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.802757    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.850698 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.850662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:25:59.903708 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.903676    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.903868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.903732    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.903868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.903780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.903868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.903838    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfhm\" (UniqueName: \"kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.904426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.904403    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.906228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.906205    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.906385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.906366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.915480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.915457    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfhm\" (UniqueName: \"kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm\") pod \"maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:25:59.948167 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:25:59.948139    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:00.025223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.025159    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:26:00.298930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.298894    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:26:00.300391 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:26:00.300355    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddee552e0_f58d_421d_abcb_589e1477a6c8.slice/crio-731b0d5faf48dd9124bf9c1422da4bf20c58ae43b9230db751e9dcdbbeb197d0 WatchSource:0}: Error finding container 731b0d5faf48dd9124bf9c1422da4bf20c58ae43b9230db751e9dcdbbeb197d0: Status 404 returned error can't find the container with id 731b0d5faf48dd9124bf9c1422da4bf20c58ae43b9230db751e9dcdbbeb197d0
Sep 19 01:26:00.472283 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.472247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:00.567185 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.567095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:00.851941 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.851834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:00.898791 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.898761    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" event={"ID":"dee552e0-f58d-421d-abcb-589e1477a6c8","Type":"ContainerStarted","Data":"b6f0f7cc3870cb5df0442c0ecdace56f25aee1ee6913f67e7edd7fea6f5515f8"}
Sep 19 01:26:00.898952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.898806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" event={"ID":"dee552e0-f58d-421d-abcb-589e1477a6c8","Type":"ContainerStarted","Data":"731b0d5faf48dd9124bf9c1422da4bf20c58ae43b9230db751e9dcdbbeb197d0"}
Sep 19 01:26:00.898952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.898832    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:26:00.924038 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:00.923991    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" podStartSLOduration=1.637285257 podStartE2EDuration="1.923975604s" totalImagesPullingTime="286.690347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:26:00.921607781 +0000 UTC m=+808.263055703" watchObservedRunningTime="2026-09-19 01:26:00.923975604 +0000 UTC m=+808.265423526"
Sep 19 01:26:01.623119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:01.623085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:02.396427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:02.396389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:02.499319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:02.499274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:03.106452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:03.106414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:04.004536 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:04.004498    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:04.718697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:04.718666    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:05.513716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:05.513675    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:06.910027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:06.909999    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:26:11.389878 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:11.389839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:14.386517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:14.386482    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:15.975485 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.975454    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerID="4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad" exitCode=0
Sep 19 01:26:15.975956 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.975536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerDied","Data":"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"}
Sep 19 01:26:15.976110 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.976093    2567 scope.go:117] "RemoveContainer" containerID="4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"
Sep 19 01:26:15.977208 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.977175    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:15.977288 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.977251    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:15.977288 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:15.977284    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:16.982636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:16.982601    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerStarted","Data":"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"}
Sep 19 01:26:17.088646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:17.088620    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:17.088817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:17.088775    2567 patch_prober.go:28] interesting pod/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 19 01:26:17.088869 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:17.088818    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 19 01:26:18.088978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:18.088942    2567 patch_prober.go:28] interesting pod/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 19 01:26:18.089366 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:18.088996    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 19 01:26:19.089430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:19.089400    2567 patch_prober.go:28] interesting pod/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 19 01:26:19.089854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:19.089456    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 19 01:26:20.088826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:20.088791    2567 patch_prober.go:28] interesting pod/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 19 01:26:20.089029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:20.088852    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 19 01:26:21.089258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:21.089225    2567 patch_prober.go:28] interesting pod/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 19 01:26:21.089641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:21.089290    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 19 01:26:22.092097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:22.092070    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:22.092486 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:22.092338    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:22.093097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:22.093079    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:26.337258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:26.337220    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:27.803626 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:27.803584    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:28.740107 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:28.740076    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:29.788098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:29.788066    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:30.657513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:30.657479    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:31.158003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:31.157968    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:31.902385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:31.902348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:33.024424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:33.024386    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:33.941013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:33.940974    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:34.885846 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:34.885806    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:36.067154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:36.067118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:37.020326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:37.020293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:38.111279 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:38.111240    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:38.990877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:38.990807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:40.130106 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:40.130073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:42.159483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:42.159445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:42.894193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:42.894162    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:26:42.894388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:42.894368    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" podUID="dee552e0-f58d-421d-abcb-589e1477a6c8" containerName="maas-api" containerID="cri-o://b6f0f7cc3870cb5df0442c0ecdace56f25aee1ee6913f67e7edd7fea6f5515f8" gracePeriod=30
Sep 19 01:26:42.910218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:42.910174    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.022199 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.022157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.121332 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.121301    2567 generic.go:356] "Generic (PLEG): container finished" podID="dee552e0-f58d-421d-abcb-589e1477a6c8" containerID="b6f0f7cc3870cb5df0442c0ecdace56f25aee1ee6913f67e7edd7fea6f5515f8" exitCode=0
Sep 19 01:26:43.121478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.121367    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" event={"ID":"dee552e0-f58d-421d-abcb-589e1477a6c8","Type":"ContainerDied","Data":"b6f0f7cc3870cb5df0442c0ecdace56f25aee1ee6913f67e7edd7fea6f5515f8"}
Sep 19 01:26:43.123714 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.123687    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.144712 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.144664    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:26:43.229111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.229078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.239991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.239968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmfhm\" (UniqueName: \"kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm\") pod \"dee552e0-f58d-421d-abcb-589e1477a6c8\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") "
Sep 19 01:26:43.240154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.240043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls\") pod \"dee552e0-f58d-421d-abcb-589e1477a6c8\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") "
Sep 19 01:26:43.240154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.240092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs\") pod \"dee552e0-f58d-421d-abcb-589e1477a6c8\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") "
Sep 19 01:26:43.240272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.240157    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca\") pod \"dee552e0-f58d-421d-abcb-589e1477a6c8\" (UID: \"dee552e0-f58d-421d-abcb-589e1477a6c8\") "
Sep 19 01:26:43.240556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.240528    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dee552e0-f58d-421d-abcb-589e1477a6c8" (UID: "dee552e0-f58d-421d-abcb-589e1477a6c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:26:43.242060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.242029    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm" (OuterVolumeSpecName: "kube-api-access-kmfhm") pod "dee552e0-f58d-421d-abcb-589e1477a6c8" (UID: "dee552e0-f58d-421d-abcb-589e1477a6c8"). InnerVolumeSpecName "kube-api-access-kmfhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:26:43.242157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.242133    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "dee552e0-f58d-421d-abcb-589e1477a6c8" (UID: "dee552e0-f58d-421d-abcb-589e1477a6c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:26:43.242508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.242495    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dee552e0-f58d-421d-abcb-589e1477a6c8" (UID: "dee552e0-f58d-421d-abcb-589e1477a6c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:26:43.341242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.341212    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmfhm\" (UniqueName: \"kubernetes.io/projected/dee552e0-f58d-421d-abcb-589e1477a6c8-kube-api-access-kmfhm\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:43.341242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.341241    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:43.341242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.341250    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dee552e0-f58d-421d-abcb-589e1477a6c8-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:43.341469 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.341258    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dee552e0-f58d-421d-abcb-589e1477a6c8-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:43.355433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.355401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.387285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.387254    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:26:43.387477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.387449    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy" containerID="cri-o://70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7" gracePeriod=30
Sep 19 01:26:43.488292 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.488040    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.810140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.810101    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:43.932071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:43.932027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:44.127373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.127305    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"
Sep 19 01:26:44.127373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.127324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j" event={"ID":"dee552e0-f58d-421d-abcb-589e1477a6c8","Type":"ContainerDied","Data":"731b0d5faf48dd9124bf9c1422da4bf20c58ae43b9230db751e9dcdbbeb197d0"}
Sep 19 01:26:44.127584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.127379    2567 scope.go:117] "RemoveContainer" containerID="b6f0f7cc3870cb5df0442c0ecdace56f25aee1ee6913f67e7edd7fea6f5515f8"
Sep 19 01:26:44.163760 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.163736    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:26:44.170443 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.170420    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-f7939b7a-59544df5cd-92l4j"]
Sep 19 01:26:44.341105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341075    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:26:44.341497 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341484    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:26:44.341545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341499    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:26:44.341545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341513    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dee552e0-f58d-421d-abcb-589e1477a6c8" containerName="maas-api"
Sep 19 01:26:44.341545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341520    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dee552e0-f58d-421d-abcb-589e1477a6c8" containerName="maas-api"
Sep 19 01:26:44.341642 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341585    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dee552e0-f58d-421d-abcb-589e1477a6c8" containerName="maas-api"
Sep 19 01:26:44.341642 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.341597    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="93bc4f90-ca3b-4951-9986-0122fdd81137" containerName="istio-proxy"
Sep 19 01:26:44.344416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.344401    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.347588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.347563    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f8c7c101-openshift-default-dockercfg-4g2gr\""
Sep 19 01:26:44.379491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.379437    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:26:44.387969 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.387857    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:44.451548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451513    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451670    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451746    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dghfp\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.451882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.451864    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553264    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553336    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dghfp\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553381    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553773 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553627    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.553932 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.554023 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553912    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.554023 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.553987    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.555632 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.555610    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.555908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.555891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.568062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.568043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.568487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.568465    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dghfp\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp\") pod \"e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") " pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.656844 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.656786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:44.757854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.757822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:44.885151 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.885116    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:44.928240 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.928140    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dee552e0-f58d-421d-abcb-589e1477a6c8" path="/var/lib/kubelet/pods/dee552e0-f58d-421d-abcb-589e1477a6c8/volumes"
Sep 19 01:26:44.953862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.953836    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:26:44.955805 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:26:44.955777    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddb2de54_477d_4902_a969_54cfc06a7746.slice/crio-607f900ff730edcbfd1ef986d5a0f0b9d60c04e4594a78a298b9f06ce1aa0dcd WatchSource:0}: Error finding container 607f900ff730edcbfd1ef986d5a0f0b9d60c04e4594a78a298b9f06ce1aa0dcd: Status 404 returned error can't find the container with id 607f900ff730edcbfd1ef986d5a0f0b9d60c04e4594a78a298b9f06ce1aa0dcd
Sep 19 01:26:44.958130 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.958095    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:44.958215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.958159    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:44.958215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:44.958193    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:26:45.137059 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:45.137012    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerStarted","Data":"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"}
Sep 19 01:26:45.137242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:45.137072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerStarted","Data":"607f900ff730edcbfd1ef986d5a0f0b9d60c04e4594a78a298b9f06ce1aa0dcd"}
Sep 19 01:26:45.183646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:45.183513    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podStartSLOduration=1.183494861 podStartE2EDuration="1.183494861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:26:45.181092471 +0000 UTC m=+852.522540393" watchObservedRunningTime="2026-09-19 01:26:45.183494861 +0000 UTC m=+852.524942991"
Sep 19 01:26:45.657954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:45.657899    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:46.039566 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:46.039534    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:46.600724 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:46.600686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:46.662556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:46.662529    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:46.756237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:46.756201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:47.148068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:47.148041    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:47.148965 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:47.148942    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:26:47.369639 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:47.369127    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:48.621819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.621788    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:48.637547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.637523    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:48.696732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696653    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.696732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696711    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.696938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696750    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.696938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696791    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.696938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696825    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.696938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696876    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:26:48.696938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.696895    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697003    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697010    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nctpx\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697052    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697078    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697084    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697199    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo\") pod \"ab8fb20b-1720-419a-b205-582ce2374b7a\" (UID: \"ab8fb20b-1720-419a-b205-582ce2374b7a\") "
Sep 19 01:26:48.697248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697210    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:26:48.697608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697560    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.697608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697579    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.697608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697592    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.697608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697605    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.697817 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.697617    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ab8fb20b-1720-419a-b205-582ce2374b7a-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.699277 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.699247    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx" (OuterVolumeSpecName: "kube-api-access-nctpx") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "kube-api-access-nctpx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:26:48.699374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.699270    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:26:48.699374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.699310    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:26:48.699521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.699499    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ab8fb20b-1720-419a-b205-582ce2374b7a" (UID: "ab8fb20b-1720-419a-b205-582ce2374b7a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:26:48.798995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.798970    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.798995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.798992    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nctpx\" (UniqueName: \"kubernetes.io/projected/ab8fb20b-1720-419a-b205-582ce2374b7a-kube-api-access-nctpx\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.799149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.799002    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:48.799149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:48.799011    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ab8fb20b-1720-419a-b205-582ce2374b7a-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:26:49.159925 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.159882    2567 generic.go:356] "Generic (PLEG): container finished" podID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerID="70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7" exitCode=0
Sep 19 01:26:49.160089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.159950    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"
Sep 19 01:26:49.160089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.159974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerDied","Data":"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"}
Sep 19 01:26:49.160089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.160034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb" event={"ID":"ab8fb20b-1720-419a-b205-582ce2374b7a","Type":"ContainerDied","Data":"5e01de7f1111448315ee531e758b509fc4d824469c9864e89cbb989c4d2af271"}
Sep 19 01:26:49.160089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.160062    2567 scope.go:117] "RemoveContainer" containerID="70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"
Sep 19 01:26:49.168928 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.168901    2567 scope.go:117] "RemoveContainer" containerID="4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"
Sep 19 01:26:49.176611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.176595    2567 scope.go:117] "RemoveContainer" containerID="70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"
Sep 19 01:26:49.176874 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:26:49.176852    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7\": container with ID starting with 70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7 not found: ID does not exist" containerID="70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"
Sep 19 01:26:49.176940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.176882    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7"} err="failed to get container status \"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7\": rpc error: code = NotFound desc = could not find container \"70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7\": container with ID starting with 70d1c6125d84ec3cf29507d6c8d807e3653333bc420b0672e0fe0fdf95b733c7 not found: ID does not exist"
Sep 19 01:26:49.176940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.176899    2567 scope.go:117] "RemoveContainer" containerID="4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"
Sep 19 01:26:49.177187 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:26:49.177171    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad\": container with ID starting with 4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad not found: ID does not exist" containerID="4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"
Sep 19 01:26:49.177252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.177193    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad"} err="failed to get container status \"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad\": rpc error: code = NotFound desc = could not find container \"4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad\": container with ID starting with 4d3ae6869fd3d831e149304132217079906f2fb17b415039e0cea6eeaf84d5ad not found: ID does not exist"
Sep 19 01:26:49.181942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.181907    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:26:49.194459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.194438    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-f7939b7a-gw-openshift-default-c489bbd8-js6sb"]
Sep 19 01:26:49.464454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.464373    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:49.708678 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:49.708638    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:50.768727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.768690    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:26:50.769416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769395    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.769416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769415    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.769584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769446    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.769584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769456    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.769584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769546    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.769584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.769561    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" containerName="istio-proxy"
Sep 19 01:26:50.771939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.771905    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:50.775663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.775639    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f8c7c101-serving-cert\""
Sep 19 01:26:50.777691 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.777667    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:26:50.804146 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.804118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:50.893382 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.893349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:50.919731 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.919695    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:50.919896 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.919744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:50.919896 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.919787    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ccz\" (UniqueName: \"kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:50.919896 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.919837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:50.921877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:50.921853    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8fb20b-1720-419a-b205-582ce2374b7a" path="/var/lib/kubelet/pods/ab8fb20b-1720-419a-b205-582ce2374b7a/volumes"
Sep 19 01:26:51.020572 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.020504    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.020701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.020648    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.020764 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.020712    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.020764 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.020744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ccz\" (UniqueName: \"kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.020955 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:26:51.020745    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-serving-cert: secret "maas-api-e2e-ait-f8c7c101-serving-cert" not found
Sep 19 01:26:51.021154 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:26:51.021131    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls podName:8f639bee-f1de-4ea3-a936-3032295e07da nodeName:}" failed. No retries permitted until 2026-09-19 01:26:51.521105885 +0000 UTC m=+858.862553795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls") pod "maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" (UID: "8f639bee-f1de-4ea3-a936-3032295e07da") : secret "maas-api-e2e-ait-f8c7c101-serving-cert" not found
Sep 19 01:26:51.021510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.021488    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.023477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.023456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.031389 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.031366    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ccz\" (UniqueName: \"kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.120498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.120474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:51.384047 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.384016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:51.499689 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.499652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:51.525936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.525884    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.528371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.528348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") pod \"maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.686123 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.686019    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:51.959667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.959592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:51.996388 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:51.996364    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:26:52.179010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:52.178979    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" event={"ID":"8f639bee-f1de-4ea3-a936-3032295e07da","Type":"ContainerStarted","Data":"c961d76b22db4af8f8e83ecf9ea5adab0bc3acd52f50e5c39426e887f3a209dd"}
Sep 19 01:26:53.186464 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:53.186419    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" event={"ID":"8f639bee-f1de-4ea3-a936-3032295e07da","Type":"ContainerStarted","Data":"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"}
Sep 19 01:26:53.186959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:53.186536    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:26:53.217720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:53.217665    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" podStartSLOduration=2.735557355 podStartE2EDuration="3.217648694s" totalImagesPullingTime="482.091339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:26:53.214970411 +0000 UTC m=+860.556418336" watchObservedRunningTime="2026-09-19 01:26:53.217648694 +0000 UTC m=+860.559096617"
Sep 19 01:26:53.249599 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:53.249571    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:54.095338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:54.095294    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:26:59.197036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:26:59.197002    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:27:09.273327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.273294    2567 generic.go:356] "Generic (PLEG): container finished" podID="ddb2de54-477d-4902-a969-54cfc06a7746" containerID="3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b" exitCode=0
Sep 19 01:27:09.273735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.273337    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerDied","Data":"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"}
Sep 19 01:27:09.273735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.273690    2567 scope.go:117] "RemoveContainer" containerID="3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"
Sep 19 01:27:09.274743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.274712    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:09.274804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.274783    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:09.274840 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:09.274812    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:10.280974 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:10.280941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerStarted","Data":"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"}
Sep 19 01:27:10.657369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:10.657293    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:10.657502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:10.657448    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 19 01:27:10.657502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:10.657489    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 19 01:27:11.657408 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:11.657373    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 19 01:27:11.657777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:11.657441    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 19 01:27:12.025076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:12.024981    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:12.657476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:12.657441    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 19 01:27:12.657865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:12.657503    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 19 01:27:13.657223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:13.657189    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 19 01:27:13.657387 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:13.657244    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 19 01:27:14.657957 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:14.657908    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 19 01:27:14.658324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:14.657974    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 19 01:27:15.661566 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:15.661534    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:15.661978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:15.661904    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:15.662602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:15.662583    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:16.068785 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:16.068754    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:16.939712 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:16.939621    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:17.800472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:17.800432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:18.776422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:18.776383    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:19.595129 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:19.595097    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:20.638729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:20.638698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:21.493604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:21.493565    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:22.217571 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:22.217530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:22.981319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:22.981283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:23.696238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:23.696204    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:28.428119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:28.428084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:28.985846 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:28.985814    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:27:28.986104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:28.986064    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" containerName="maas-api" containerID="cri-o://3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c" gracePeriod=30
Sep 19 01:27:29.021720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.021688    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:29.121851 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.121818    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:29.223541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.223505    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:29.242015 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.241953    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:27:29.297419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.297389    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2ccz\" (UniqueName: \"kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz\") pod \"8f639bee-f1de-4ea3-a936-3032295e07da\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") "
Sep 19 01:27:29.297559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.297466    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca\") pod \"8f639bee-f1de-4ea3-a936-3032295e07da\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") "
Sep 19 01:27:29.297559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.297536    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") pod \"8f639bee-f1de-4ea3-a936-3032295e07da\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") "
Sep 19 01:27:29.297677 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.297592    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs\") pod \"8f639bee-f1de-4ea3-a936-3032295e07da\" (UID: \"8f639bee-f1de-4ea3-a936-3032295e07da\") "
Sep 19 01:27:29.297989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.297955    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8f639bee-f1de-4ea3-a936-3032295e07da" (UID: "8f639bee-f1de-4ea3-a936-3032295e07da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:27:29.299646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.299613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz" (OuterVolumeSpecName: "kube-api-access-v2ccz") pod "8f639bee-f1de-4ea3-a936-3032295e07da" (UID: "8f639bee-f1de-4ea3-a936-3032295e07da"). InnerVolumeSpecName "kube-api-access-v2ccz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:27:29.299784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.299745    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8f639bee-f1de-4ea3-a936-3032295e07da" (UID: "8f639bee-f1de-4ea3-a936-3032295e07da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:27:29.299851 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.299796    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8f639bee-f1de-4ea3-a936-3032295e07da" (UID: "8f639bee-f1de-4ea3-a936-3032295e07da"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:27:29.322304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.322277    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:29.403946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.402873    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2ccz\" (UniqueName: \"kubernetes.io/projected/8f639bee-f1de-4ea3-a936-3032295e07da-kube-api-access-v2ccz\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:29.403946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.403571    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f639bee-f1de-4ea3-a936-3032295e07da-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:29.403946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.403589    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:29.403946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.403604    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f639bee-f1de-4ea3-a936-3032295e07da-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:29.405749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.405629    2567 generic.go:356] "Generic (PLEG): container finished" podID="8f639bee-f1de-4ea3-a936-3032295e07da" containerID="3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c" exitCode=0
Sep 19 01:27:29.405911 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.405770    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"
Sep 19 01:27:29.406169 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.406051    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" event={"ID":"8f639bee-f1de-4ea3-a936-3032295e07da","Type":"ContainerDied","Data":"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"}
Sep 19 01:27:29.406368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.406279    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" event={"ID":"8f639bee-f1de-4ea3-a936-3032295e07da","Type":"ContainerDied","Data":"c961d76b22db4af8f8e83ecf9ea5adab0bc3acd52f50e5c39426e887f3a209dd"}
Sep 19 01:27:29.406368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.406329    2567 scope.go:117] "RemoveContainer" containerID="3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"
Sep 19 01:27:29.429885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.429863    2567 scope.go:117] "RemoveContainer" containerID="3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"
Sep 19 01:27:29.430277 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:27:29.430247    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c\": container with ID starting with 3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c not found: ID does not exist" containerID="3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"
Sep 19 01:27:29.430324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.430291    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c"} err="failed to get container status \"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c\": rpc error: code = NotFound desc = could not find container \"3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c\": container with ID starting with 3323378246d4f034f046e8c4b602cf3ad378ce8278864b1e8455e9b87bf25a9c not found: ID does not exist"
Sep 19 01:27:29.438236 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.438215    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:27:29.443644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.443621    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc"]
Sep 19 01:27:29.715593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:29.715560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:30.417614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.417581    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:30.424640 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.424611    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:27:30.424879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.424853    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" containerID="cri-o://ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9" gracePeriod=30
Sep 19 01:27:30.520487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.520453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:30.664681 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.664651    2567 patch_prober.go:28] interesting pod/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 01:27:30.664824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.664727    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 01:27:30.919491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.919452    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:30.922205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:30.922181    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" path="/var/lib/kubelet/pods/8f639bee-f1de-4ea3-a936-3032295e07da/volumes"
Sep 19 01:27:31.183783 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.183707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:31.257116 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.257079    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:27:31.257606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.257592    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" containerName="maas-api"
Sep 19 01:27:31.257668 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.257608    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" containerName="maas-api"
Sep 19 01:27:31.257722 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.257688    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" containerName="maas-api"
Sep 19 01:27:31.260495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.260479    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.263048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.263024    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-55340d68-openshift-default-dockercfg-p8lhb\""
Sep 19 01:27:31.278520 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.278501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:27:31.284032 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.284004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:31.319668 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319875 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319839    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319905    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.319974 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.320011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.319984    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.320046 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.320011    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqjc\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.420799 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.420768    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.420799 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.420803    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.420824    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.420843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqjc\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.420937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421062 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421137    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421378    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421619    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.421813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.421790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.423298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.423267    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.423418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.423355    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.429033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.429013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.429248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.429231    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqjc\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc\") pod \"e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") " pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.476565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.476488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:31.571398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.571367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:31.846480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.846455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:27:31.848218 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:27:31.848187    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da009a9_ae18_4cfb_9250_13d7c1102e15.slice/crio-ff061c5faf2b583f49996e2c2b8006273731a6fbcc804da4bb370365b8608d0e WatchSource:0}: Error finding container ff061c5faf2b583f49996e2c2b8006273731a6fbcc804da4bb370365b8608d0e: Status 404 returned error can't find the container with id ff061c5faf2b583f49996e2c2b8006273731a6fbcc804da4bb370365b8608d0e
Sep 19 01:27:31.850703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.850663    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:31.850779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.850757    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:31.850821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:31.850803    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:32.148070 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.147994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:32.193580 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.193518    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8c7c101-7458dcf5b4-659bc" podUID="8f639bee-f1de-4ea3-a936-3032295e07da" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.46:8443/health\": context deadline exceeded"
Sep 19 01:27:32.427984 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.427875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerStarted","Data":"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"}
Sep 19 01:27:32.427984 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.427960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerStarted","Data":"ff061c5faf2b583f49996e2c2b8006273731a6fbcc804da4bb370365b8608d0e"}
Sep 19 01:27:32.453061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.453013    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podStartSLOduration=1.452997193 podStartE2EDuration="1.452997193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:27:32.452151401 +0000 UTC m=+899.793599325" watchObservedRunningTime="2026-09-19 01:27:32.452997193 +0000 UTC m=+899.794445115"
Sep 19 01:27:32.572570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.572529    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:32.573770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.573703    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:27:32.573907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:32.573764    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:27:33.023359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:33.023327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:33.576034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:33.576006    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:33.763111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:33.763076    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:33.947155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:33.947071    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:34.049242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.049208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:34.437645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.437609    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:34.438622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.438604    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:27:34.737881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.737800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:34.910359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.910335    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:27:34.912548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:34.912528    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:27:35.631513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.631478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:35.681699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.681677    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:35.765876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.765800    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.765876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.765849    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.765890    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.765988    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766034    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766109    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766134    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766150    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766185    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dghfp\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy\") pod \"ddb2de54-477d-4902-a969-54cfc06a7746\" (UID: \"ddb2de54-477d-4902-a969-54cfc06a7746\") "
Sep 19 01:27:35.766356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766317    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766361    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766373    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766595    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766614    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766628    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766641    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.766816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.766653    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddb2de54-477d-4902-a969-54cfc06a7746-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.768295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.768267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:27:35.768444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.768298    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp" (OuterVolumeSpecName: "kube-api-access-dghfp") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "kube-api-access-dghfp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:27:35.768745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.768722    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:27:35.768831 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.768777    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddb2de54-477d-4902-a969-54cfc06a7746" (UID: "ddb2de54-477d-4902-a969-54cfc06a7746"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:27:35.867502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.867468    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.867502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.867500    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddb2de54-477d-4902-a969-54cfc06a7746-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.867502 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.867509    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dghfp\" (UniqueName: \"kubernetes.io/projected/ddb2de54-477d-4902-a969-54cfc06a7746-kube-api-access-dghfp\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:35.867657 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:35.867517    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddb2de54-477d-4902-a969-54cfc06a7746-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:27:36.317691 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.317645    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:36.449976 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.449944    2567 generic.go:356] "Generic (PLEG): container finished" podID="ddb2de54-477d-4902-a969-54cfc06a7746" containerID="ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9" exitCode=0
Sep 19 01:27:36.450128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.449990    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"
Sep 19 01:27:36.450128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.450034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerDied","Data":"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"}
Sep 19 01:27:36.450128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.450088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl" event={"ID":"ddb2de54-477d-4902-a969-54cfc06a7746","Type":"ContainerDied","Data":"607f900ff730edcbfd1ef986d5a0f0b9d60c04e4594a78a298b9f06ce1aa0dcd"}
Sep 19 01:27:36.450128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.450119    2567 scope.go:117] "RemoveContainer" containerID="ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"
Sep 19 01:27:36.460995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.460975    2567 scope.go:117] "RemoveContainer" containerID="3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"
Sep 19 01:27:36.469092 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.469076    2567 scope.go:117] "RemoveContainer" containerID="ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"
Sep 19 01:27:36.469356 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:27:36.469341    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9\": container with ID starting with ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9 not found: ID does not exist" containerID="ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"
Sep 19 01:27:36.469396 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.469365    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9"} err="failed to get container status \"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9\": rpc error: code = NotFound desc = could not find container \"ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9\": container with ID starting with ae0722242b351442453acbbb6961e0d4a34244a1be376ba9cf22ea2bfdbb6fb9 not found: ID does not exist"
Sep 19 01:27:36.469396 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.469379    2567 scope.go:117] "RemoveContainer" containerID="3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"
Sep 19 01:27:36.469600 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:27:36.469584    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b\": container with ID starting with 3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b not found: ID does not exist" containerID="3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"
Sep 19 01:27:36.469645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.469605    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b"} err="failed to get container status \"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b\": rpc error: code = NotFound desc = could not find container \"3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b\": container with ID starting with 3e2362ea701cb9420e8495322ecfb2129b6f46f955bfba2a9896cbb562ebeb8b not found: ID does not exist"
Sep 19 01:27:36.479696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.479677    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:27:36.488825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.488803    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f8c7c101-openshift-default-7fb9fd8df4-8tvhl"]
Sep 19 01:27:36.927224 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:36.927173    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" path="/var/lib/kubelet/pods/ddb2de54-477d-4902-a969-54cfc06a7746/volumes"
Sep 19 01:27:37.081842 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:37.081808    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:37.907676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:37.907643    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:38.671175 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671138    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:27:38.671812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671790    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.671880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671816    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.671880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671835    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.671880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671844    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.672091 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671962    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.672091 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.671976    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddb2de54-477d-4902-a969-54cfc06a7746" containerName="istio-proxy"
Sep 19 01:27:38.675633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.675612    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.678013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.677992    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-55340d68-serving-cert\""
Sep 19 01:27:38.689511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.689488    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:27:38.794282 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.794251    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.794460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.794290    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk4xq\" (UniqueName: \"kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.794460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.794314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.794556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.794455    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.895759 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.895724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk4xq\" (UniqueName: \"kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.895976 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.895770    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.895976 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.895835    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.896112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.895990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.896429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.896407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.898349 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.898328    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.898422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.898331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.905409 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.905390    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk4xq\" (UniqueName: \"kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq\") pod \"maas-api-e2e-derive-55340d68-6df9b798cc-twm69\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:38.989143 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:38.989085    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:39.275541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:39.275515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:27:39.277732 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:27:39.277703    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34f2a7a_6834_4b21_94c7_6c5984f9e5ff.slice/crio-b33034d54105a37e8ce53cf7fcb1f68bfadc995372618d75e1f5031530d70ecb WatchSource:0}: Error finding container b33034d54105a37e8ce53cf7fcb1f68bfadc995372618d75e1f5031530d70ecb: Status 404 returned error can't find the container with id b33034d54105a37e8ce53cf7fcb1f68bfadc995372618d75e1f5031530d70ecb
Sep 19 01:27:39.321483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:39.321432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:39.418020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:39.417990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:39.467871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:39.467842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" event={"ID":"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff","Type":"ContainerStarted","Data":"b33034d54105a37e8ce53cf7fcb1f68bfadc995372618d75e1f5031530d70ecb"}
Sep 19 01:27:40.473625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:40.473585    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" event={"ID":"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff","Type":"ContainerStarted","Data":"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"}
Sep 19 01:27:40.474112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:40.473694    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:40.492703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:40.492646    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" podStartSLOduration=1.962468667 podStartE2EDuration="2.492634098s" totalImagesPullingTime="530.165431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:27:40.490511969 +0000 UTC m=+907.831959893" watchObservedRunningTime="2026-09-19 01:27:40.492634098 +0000 UTC m=+907.834082048"
Sep 19 01:27:42.795742 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:42.795711    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:42.895848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:42.895824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:46.483276 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:46.483248    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:27:58.575851 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.575817    2567 generic.go:356] "Generic (PLEG): container finished" podID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerID="fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1" exitCode=0
Sep 19 01:27:58.576393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.575890    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerDied","Data":"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"}
Sep 19 01:27:58.576456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.576443    2567 scope.go:117] "RemoveContainer" containerID="fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"
Sep 19 01:27:58.577610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.577580    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:58.577716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.577665    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:58.577784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:58.577730    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:27:59.422942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:59.421456    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:27:59.583339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:27:59.583305    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerStarted","Data":"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"}
Sep 19 01:28:00.572071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:00.572034    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:00.573191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:00.573170    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:28:00.573248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:00.573217    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:28:01.571683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:01.571646    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:28:01.572056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:01.571703    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:28:02.571814 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:02.571778    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:28:02.572207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:02.571831    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:28:02.923787 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:02.923677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:03.571666 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:03.571626    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:28:03.571842 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:03.571678    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:28:03.620865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:03.620784    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:04.438445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:04.438413    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:04.511604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:04.511564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:04.572048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:04.572013    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 19 01:28:04.572439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:04.572068    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 19 01:28:05.197950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:05.197900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:05.576326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:05.576298    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:05.577350 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:05.577332    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:06.042238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:06.042202    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:07.369676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:07.369639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:08.224583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:08.224551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:09.038034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:09.038003    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:09.744135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:09.744103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:12.965369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:12.965333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:13.861541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:13.861505    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:14.803821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:14.803788    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:15.494437 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:15.494401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:16.198326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:16.198292    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:17.164040 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:17.164004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:17.816022 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:17.815987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:18.612467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:18.612427    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.296575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.296541    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:28:19.296959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.296743    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" podUID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" containerName="maas-api" containerID="cri-o://09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d" gracePeriod=30
Sep 19 01:28:19.306529 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.306499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.406756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.406723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.507685 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.507644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.549097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.549046    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:28:19.608285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.608248    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.661478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.661446    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:28:19.661676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.661652    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" containerID="cri-o://0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387" gracePeriod=30
Sep 19 01:28:19.686287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.686260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:19.703306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca\") pod \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") "
Sep 19 01:28:19.703440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703317    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk4xq\" (UniqueName: \"kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq\") pod \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") "
Sep 19 01:28:19.703440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703401    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs\") pod \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") "
Sep 19 01:28:19.703440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703435    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls\") pod \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\" (UID: \"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff\") "
Sep 19 01:28:19.703718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703691    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" (UID: "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:28:19.703812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.703761    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:19.706035 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706008    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq" (OuterVolumeSpecName: "kube-api-access-pk4xq") pod "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" (UID: "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff"). InnerVolumeSpecName "kube-api-access-pk4xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:28:19.706261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706233    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" (UID: "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:19.706508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706488    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" (UID: "e34f2a7a-6834-4b21-94c7-6c5984f9e5ff"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:19.706602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706535    2567 generic.go:356] "Generic (PLEG): container finished" podID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" containerID="09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d" exitCode=0
Sep 19 01:28:19.706602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706574    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"
Sep 19 01:28:19.706602 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" event={"ID":"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff","Type":"ContainerDied","Data":"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"}
Sep 19 01:28:19.706775 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69" event={"ID":"e34f2a7a-6834-4b21-94c7-6c5984f9e5ff","Type":"ContainerDied","Data":"b33034d54105a37e8ce53cf7fcb1f68bfadc995372618d75e1f5031530d70ecb"}
Sep 19 01:28:19.706775 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.706662    2567 scope.go:117] "RemoveContainer" containerID="09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"
Sep 19 01:28:19.725992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.725975    2567 scope.go:117] "RemoveContainer" containerID="09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"
Sep 19 01:28:19.726236 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:28:19.726216    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d\": container with ID starting with 09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d not found: ID does not exist" containerID="09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"
Sep 19 01:28:19.726293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.726252    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d"} err="failed to get container status \"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d\": rpc error: code = NotFound desc = could not find container \"09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d\": container with ID starting with 09cdfdc785ebf2e9fada11065928678b5ac29b200ebebcc28a5aec4f78ef7f7d not found: ID does not exist"
Sep 19 01:28:19.737563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.737539    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:28:19.741547 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.741525    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-55340d68-6df9b798cc-twm69"]
Sep 19 01:28:19.804511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.804425    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk4xq\" (UniqueName: \"kubernetes.io/projected/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-kube-api-access-pk4xq\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:19.804511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.804455    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:19.804511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:19.804464    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:20.396859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.396813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:20.491735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.491698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:20.578977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.578945    2567 patch_prober.go:28] interesting pod/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 01:28:20.579144 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.579022    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 01:28:20.591264 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.591237    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:20.920452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:20.920419    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" path="/var/lib/kubelet/pods/e34f2a7a-6834-4b21-94c7-6c5984f9e5ff/volumes"
Sep 19 01:28:21.220368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:21.220295    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:21.976242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:21.976200    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:22.078692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:22.078657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:22.891544 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:22.891506    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:23.718596 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:23.718564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:24.928569 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:24.928512    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:24.929117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:24.929096    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:28:24.929296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:24.929276    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" podUID="3328f79a-4687-433a-a5bb-dd8ac36b9665" containerName="maas-api" containerID="cri-o://c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f" gracePeriod=30
Sep 19 01:28:25.052694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.052665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.052829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.052720    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.052829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.052755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.052993 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.052965    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:28:25.053121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053053    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.053303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053282    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:28:25.053385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053327    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.053447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053415    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.053701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053681    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.053794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053723    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xqjc\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.053794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053767    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert\") pod \"2da009a9-ae18-4cfb-9250-13d7c1102e15\" (UID: \"2da009a9-ae18-4cfb-9250-13d7c1102e15\") "
Sep 19 01:28:25.054357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.053619    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:28:25.054357 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.054236    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data" (OuterVolumeSpecName: "istio-data") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:28:25.054510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.054393    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:28:25.055237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055212    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token" (OuterVolumeSpecName: "istio-token") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:28:25.055338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055289    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2da009a9-ae18-4cfb-9250-13d7c1102e15-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.055338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055308    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.055338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055323    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.055510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055338    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.055510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055352    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.055510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.055455    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:28:25.056054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.056030    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:28:25.056947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.056903    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc" (OuterVolumeSpecName: "kube-api-access-2xqjc") pod "2da009a9-ae18-4cfb-9250-13d7c1102e15" (UID: "2da009a9-ae18-4cfb-9250-13d7c1102e15"). InnerVolumeSpecName "kube-api-access-2xqjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:28:25.094952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.094885    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:25.156255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.156216    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.156255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.156243    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.156255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.156251    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2da009a9-ae18-4cfb-9250-13d7c1102e15-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.156255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.156260    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xqjc\" (UniqueName: \"kubernetes.io/projected/2da009a9-ae18-4cfb-9250-13d7c1102e15-kube-api-access-2xqjc\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.176188 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.176159    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:28:25.253508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.253415    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:25.359717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.359092    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca\") pod \"3328f79a-4687-433a-a5bb-dd8ac36b9665\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") "
Sep 19 01:28:25.359717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.359161    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") pod \"3328f79a-4687-433a-a5bb-dd8ac36b9665\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") "
Sep 19 01:28:25.359717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.359291    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs\") pod \"3328f79a-4687-433a-a5bb-dd8ac36b9665\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") "
Sep 19 01:28:25.359717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.359431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5wjx\" (UniqueName: \"kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx\") pod \"3328f79a-4687-433a-a5bb-dd8ac36b9665\" (UID: \"3328f79a-4687-433a-a5bb-dd8ac36b9665\") "
Sep 19 01:28:25.360108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.359961    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3328f79a-4687-433a-a5bb-dd8ac36b9665" (UID: "3328f79a-4687-433a-a5bb-dd8ac36b9665"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:28:25.362738 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.362697    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx" (OuterVolumeSpecName: "kube-api-access-n5wjx") pod "3328f79a-4687-433a-a5bb-dd8ac36b9665" (UID: "3328f79a-4687-433a-a5bb-dd8ac36b9665"). InnerVolumeSpecName "kube-api-access-n5wjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:28:25.364348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.364306    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3328f79a-4687-433a-a5bb-dd8ac36b9665" (UID: "3328f79a-4687-433a-a5bb-dd8ac36b9665"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:25.364485 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.364317    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3328f79a-4687-433a-a5bb-dd8ac36b9665" (UID: "3328f79a-4687-433a-a5bb-dd8ac36b9665"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:25.405936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.405880    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:25.460427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.460401    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3328f79a-4687-433a-a5bb-dd8ac36b9665-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.460427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.460426    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.460604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.460440    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3328f79a-4687-433a-a5bb-dd8ac36b9665-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.460604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.460452    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5wjx\" (UniqueName: \"kubernetes.io/projected/3328f79a-4687-433a-a5bb-dd8ac36b9665-kube-api-access-n5wjx\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:25.520147 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.520057    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:25.740145 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.740120    2567 generic.go:356] "Generic (PLEG): container finished" podID="3328f79a-4687-433a-a5bb-dd8ac36b9665" containerID="c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f" exitCode=0
Sep 19 01:28:25.740297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.740164    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"
Sep 19 01:28:25.740297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.740200    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" event={"ID":"3328f79a-4687-433a-a5bb-dd8ac36b9665","Type":"ContainerDied","Data":"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"}
Sep 19 01:28:25.740297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.740246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d" event={"ID":"3328f79a-4687-433a-a5bb-dd8ac36b9665","Type":"ContainerDied","Data":"001103c29f3e4e9719cd6fd33ddf381390d76e9777e5ba2a2e2d841e03b87e8d"}
Sep 19 01:28:25.740297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.740267    2567 scope.go:117] "RemoveContainer" containerID="c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"
Sep 19 01:28:25.742131 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.742109    2567 generic.go:356] "Generic (PLEG): container finished" podID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerID="0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387" exitCode=0
Sep 19 01:28:25.742262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.742131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerDied","Data":"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"}
Sep 19 01:28:25.742262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.742171    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"
Sep 19 01:28:25.742262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.742181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz" event={"ID":"2da009a9-ae18-4cfb-9250-13d7c1102e15","Type":"ContainerDied","Data":"ff061c5faf2b583f49996e2c2b8006273731a6fbcc804da4bb370365b8608d0e"}
Sep 19 01:28:25.749543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.749523    2567 scope.go:117] "RemoveContainer" containerID="c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"
Sep 19 01:28:25.749847 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:28:25.749826    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f\": container with ID starting with c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f not found: ID does not exist" containerID="c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"
Sep 19 01:28:25.749971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.749856    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f"} err="failed to get container status \"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f\": rpc error: code = NotFound desc = could not find container \"c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f\": container with ID starting with c12dc5c8a5849e2eaee2b8b44b10986fb824ee644b1d815a05218429c0debb3f not found: ID does not exist"
Sep 19 01:28:25.749971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.749878    2567 scope.go:117] "RemoveContainer" containerID="0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"
Sep 19 01:28:25.758398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.758382    2567 scope.go:117] "RemoveContainer" containerID="fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"
Sep 19 01:28:25.765840 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.765823    2567 scope.go:117] "RemoveContainer" containerID="0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"
Sep 19 01:28:25.766116 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:28:25.766094    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387\": container with ID starting with 0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387 not found: ID does not exist" containerID="0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"
Sep 19 01:28:25.766202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.766119    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387"} err="failed to get container status \"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387\": rpc error: code = NotFound desc = could not find container \"0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387\": container with ID starting with 0a6f549280ecbdb19255904c6acd1597ecf648c6d5d52dc021e9074e02cdf387 not found: ID does not exist"
Sep 19 01:28:25.766202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.766135    2567 scope.go:117] "RemoveContainer" containerID="fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"
Sep 19 01:28:25.766374 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:28:25.766360    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1\": container with ID starting with fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1 not found: ID does not exist" containerID="fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"
Sep 19 01:28:25.766424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.766376    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1"} err="failed to get container status \"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1\": rpc error: code = NotFound desc = could not find container \"fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1\": container with ID starting with fdfdc0306759c8a0e2b4c809a77524aef8439e20dd9fbf605c244ce5bee0d0f1 not found: ID does not exist"
Sep 19 01:28:25.771179 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.771134    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:28:25.779629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.779598    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-44f561-5cf67bc496-ncs5d"]
Sep 19 01:28:25.805156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.805130    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:28:25.809125 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.809105    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-55340d68-openshift-default-8475dc9fb-cfhgz"]
Sep 19 01:28:25.875800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.875778    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:25.983560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:25.983526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:26.920554 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:26.920518    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" path="/var/lib/kubelet/pods/2da009a9-ae18-4cfb-9250-13d7c1102e15/volumes"
Sep 19 01:28:26.920943 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:26.920911    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3328f79a-4687-433a-a5bb-dd8ac36b9665" path="/var/lib/kubelet/pods/3328f79a-4687-433a-a5bb-dd8ac36b9665/volumes"
Sep 19 01:28:27.060711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:27.060678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:28.149600 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:28.149567    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:29.107412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:29.107374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:29.894617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:29.894531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:30.003320 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:30.003277    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:30.095936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:30.095878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:30.197838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:30.197758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:30.772431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:30.772390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:30.939191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:30.939158    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:37.969314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:37.969281    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:40.718373 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:40.718334    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:41.036726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:41.036691    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:42.126640 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:42.126597    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:43.017322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:43.017286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:43.717593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:43.717560    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:44.559551 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:44.559518    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:44.928541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:44.928458    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:45.290866 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:45.290833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:45.392905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:45.392867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:45.747626 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:45.747545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:51.356153 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.356120    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:28:51.356654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.356353    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" podUID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" containerName="maas-api" containerID="cri-o://d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e" gracePeriod=30
Sep 19 01:28:51.385798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.385767    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:51.454637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.454598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:51.555690 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.555653    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:51.592662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.592640    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:28:51.654095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.654024    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:51.706635 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.706609    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca\") pod \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") "
Sep 19 01:28:51.706764 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.706742    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs\") pod \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") "
Sep 19 01:28:51.706829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.706771    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgftq\" (UniqueName: \"kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq\") pod \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") "
Sep 19 01:28:51.706829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.706814    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") pod \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\" (UID: \"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce\") "
Sep 19 01:28:51.706989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.706968    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" (UID: "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:28:51.707161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.707145    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:51.708882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.708853    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" (UID: "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:51.708882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.708867    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" (UID: "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:28:51.709079 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.708894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq" (OuterVolumeSpecName: "kube-api-access-bgftq") pod "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" (UID: "c7bf7151-0ee5-4563-a2fd-19aaee62a3ce"). InnerVolumeSpecName "kube-api-access-bgftq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:28:51.808384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.808352    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:51.808384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.808378    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgftq\" (UniqueName: \"kubernetes.io/projected/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-kube-api-access-bgftq\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:51.808384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.808387    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:28:51.870815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.870785    2567 generic.go:356] "Generic (PLEG): container finished" podID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" containerID="d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e" exitCode=0
Sep 19 01:28:51.870983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.870832    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"
Sep 19 01:28:51.870983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.870842    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" event={"ID":"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce","Type":"ContainerDied","Data":"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"}
Sep 19 01:28:51.870983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.870882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc" event={"ID":"c7bf7151-0ee5-4563-a2fd-19aaee62a3ce","Type":"ContainerDied","Data":"a9953459788c4b3ec572e8cd10390aca34470ae0a3e51d11adbb22609dc08cbe"}
Sep 19 01:28:51.870983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.870902    2567 scope.go:117] "RemoveContainer" containerID="d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"
Sep 19 01:28:51.881037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.881019    2567 scope.go:117] "RemoveContainer" containerID="d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"
Sep 19 01:28:51.881298 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:28:51.881279    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e\": container with ID starting with d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e not found: ID does not exist" containerID="d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"
Sep 19 01:28:51.881345 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.881306    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e"} err="failed to get container status \"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e\": rpc error: code = NotFound desc = could not find container \"d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e\": container with ID starting with d7b6796de9195e60c6079cce432ede33e10d3bb5a33ceb981186e7f94fe8474e not found: ID does not exist"
Sep 19 01:28:51.906024 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.905958    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:28:51.917102 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:51.917080    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-b3b22c-8668f5f44f-8njzc"]
Sep 19 01:28:52.102232 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:52.102206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:52.339025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:52.338990    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:52.922099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:52.922067    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" path="/var/lib/kubelet/pods/c7bf7151-0ee5-4563-a2fd-19aaee62a3ce/volumes"
Sep 19 01:28:53.155083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:53.155049    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:54.432329 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:54.432293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:55.463616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:55.463576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:56.885433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:56.885394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:58.226476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:58.226432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:58.293706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:58.293678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:28:58.547737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:58.547703    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:28:58.547961 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:58.547929    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy" containerID="cri-o://5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040" gracePeriod=30
Sep 19 01:28:58.578419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:28:58.578395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:03.227257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.227214    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:03.328322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.328289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:03.438200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.438163    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:03.536514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.536486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:03.795238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.795176    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:29:03.922871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.922842    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.922885    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.922955    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fnwd\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.922987    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923037    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923070    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923175    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923211    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923233    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert\") pod \"079963b3-11cd-449a-b5bc-88533144c1eb\" (UID: \"079963b3-11cd-449a-b5bc-88533144c1eb\") "
Sep 19 01:29:03.923491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:29:03.923491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923456    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data" (OuterVolumeSpecName: "istio-data") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:29:03.923491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923469    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:29:03.923661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923538    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:29:03.923661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923646    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:03.923779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923666    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:03.923779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923677    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:03.923779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923689    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:03.923906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.923773    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:29:03.925335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.925305    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd" (OuterVolumeSpecName: "kube-api-access-6fnwd") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "kube-api-access-6fnwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:29:03.925442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.925413    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:29:03.925549 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.925526    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:29:03.925584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.925534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token" (OuterVolumeSpecName: "istio-token") pod "079963b3-11cd-449a-b5bc-88533144c1eb" (UID: "079963b3-11cd-449a-b5bc-88533144c1eb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:29:03.937170 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.937145    2567 generic.go:356] "Generic (PLEG): container finished" podID="079963b3-11cd-449a-b5bc-88533144c1eb" containerID="5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040" exitCode=0
Sep 19 01:29:03.937252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.937187    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"
Sep 19 01:29:03.937252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.937226    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerDied","Data":"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"}
Sep 19 01:29:03.937346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.937277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl" event={"ID":"079963b3-11cd-449a-b5bc-88533144c1eb","Type":"ContainerDied","Data":"899ef17352bb8dca42ceab3acca1ab077b9a644b1ded15b61a3a46865046d777"}
Sep 19 01:29:03.937346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.937301    2567 scope.go:117] "RemoveContainer" containerID="5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"
Sep 19 01:29:03.946099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.946084    2567 scope.go:117] "RemoveContainer" containerID="233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"
Sep 19 01:29:03.953706 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.953690    2567 scope.go:117] "RemoveContainer" containerID="5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"
Sep 19 01:29:03.953977 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:29:03.953959    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040\": container with ID starting with 5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040 not found: ID does not exist" containerID="5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"
Sep 19 01:29:03.954028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.953985    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040"} err="failed to get container status \"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040\": rpc error: code = NotFound desc = could not find container \"5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040\": container with ID starting with 5d4cc512ca6d12133572e2cee0214c630e2735faf4d7ccb88e45bafcdc931040 not found: ID does not exist"
Sep 19 01:29:03.954028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.954002    2567 scope.go:117] "RemoveContainer" containerID="233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"
Sep 19 01:29:03.954266 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:29:03.954249    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9\": container with ID starting with 233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9 not found: ID does not exist" containerID="233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"
Sep 19 01:29:03.954305 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.954272    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9"} err="failed to get container status \"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9\": rpc error: code = NotFound desc = could not find container \"233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9\": container with ID starting with 233935e8d4e2ac45029e75b8645b58a39b8d817b7ef06a4156dd967d65efd8c9 not found: ID does not exist"
Sep 19 01:29:03.972350 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.972329    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:29:03.986446 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:03.986423    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-b3b22c-openshift-default-86c99798d4-vt8bl"]
Sep 19 01:29:04.024210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.024190    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/079963b3-11cd-449a-b5bc-88533144c1eb-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:04.024210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.024209    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/079963b3-11cd-449a-b5bc-88533144c1eb-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:04.024298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.024218    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/079963b3-11cd-449a-b5bc-88533144c1eb-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:04.024298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.024226    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:04.024298 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.024235    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fnwd\" (UniqueName: \"kubernetes.io/projected/079963b3-11cd-449a-b5bc-88533144c1eb-kube-api-access-6fnwd\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:29:04.921068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:04.921037    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" path="/var/lib/kubelet/pods/079963b3-11cd-449a-b5bc-88533144c1eb/volumes"
Sep 19 01:29:17.588858 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.588820    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:29:17.589416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589397    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589417    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589431    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589438    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589448    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589454    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589462    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" containerName="maas-api"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589467    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" containerName="maas-api"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589473    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" containerName="maas-api"
Sep 19 01:29:17.589487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589478    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589496    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3328f79a-4687-433a-a5bb-dd8ac36b9665" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589502    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3328f79a-4687-433a-a5bb-dd8ac36b9665" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589559    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589567    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3328f79a-4687-433a-a5bb-dd8ac36b9665" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589574    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7bf7151-0ee5-4563-a2fd-19aaee62a3ce" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589580    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e34f2a7a-6834-4b21-94c7-6c5984f9e5ff" containerName="maas-api"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589586    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.589977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.589592    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="079963b3-11cd-449a-b5bc-88533144c1eb" containerName="istio-proxy"
Sep 19 01:29:17.592393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.592372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.595864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.595841    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-8e708f\"/\"kube-root-ca.crt\""
Sep 19 01:29:17.596038 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.595851    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-8e708f\"/\"openshift-service-ca.crt\""
Sep 19 01:29:17.596150 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.595851    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-8e708f\"/\"premium-w0-8e708f-kserve-self-signed-certs\""
Sep 19 01:29:17.596254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.595875    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-8e708f\"/\"default-dockercfg-slhlm\""
Sep 19 01:29:17.601543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.601318    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:29:17.620134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.620108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:17.632294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632273    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.632377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4txj\" (UniqueName: \"kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.632440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.632508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.632573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632556    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.632630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.632594    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.733774 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.733741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.733774 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.733780    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.733909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.733946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4txj\" (UniqueName: \"kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.734010    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734224 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.734078    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734284 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.734247    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734284 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.734266    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.734444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.734422    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.736200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.736182    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.736491 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.736473    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.741963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.741946    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4txj\" (UniqueName: \"kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj\") pod \"premium-w0-8e708f-kserve-647fd79d6b-kgjxk\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") " pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:17.904983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:17.904870    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:18.181339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:18.181313    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:29:18.183512 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:29:18.183482    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddac683cd_2285_45e9_a2b6_ee8897dcb8b7.slice/crio-3579bb8a4f16d550a77121bb8422df0a1007ba34217cd8754132f53d93171309 WatchSource:0}: Error finding container 3579bb8a4f16d550a77121bb8422df0a1007ba34217cd8754132f53d93171309: Status 404 returned error can't find the container with id 3579bb8a4f16d550a77121bb8422df0a1007ba34217cd8754132f53d93171309
Sep 19 01:29:18.359592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:18.359538    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:18.670403 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:18.670367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:19.006515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.006430    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" event={"ID":"dac683cd-2285-45e9-a2b6-ee8897dcb8b7","Type":"ContainerStarted","Data":"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"}
Sep 19 01:29:19.006515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.006474    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" event={"ID":"dac683cd-2285-45e9-a2b6-ee8897dcb8b7","Type":"ContainerStarted","Data":"3579bb8a4f16d550a77121bb8422df0a1007ba34217cd8754132f53d93171309"}
Sep 19 01:29:19.026645 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.026580    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" podStartSLOduration=2.026566938 podStartE2EDuration="2.026566938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:29:19.024535067 +0000 UTC m=+1006.365982991" watchObservedRunningTime="2026-09-19 01:29:19.026566938 +0000 UTC m=+1006.368014860"
Sep 19 01:29:19.141692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.141656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:19.375676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.375641    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:19.446711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.446678    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:29:19.447360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.447342    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:19.447416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.447363    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:19.447461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.447450    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da009a9-ae18-4cfb-9250-13d7c1102e15" containerName="istio-proxy"
Sep 19 01:29:19.449811 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.449788    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.452535 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.452510    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-cf0ace-openshift-default-dockercfg-zfszz\""
Sep 19 01:29:19.463548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.463524    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:29:19.477499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.477468    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:19.550284 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550255    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550289    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550333    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550382    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550423    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550442    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwq84\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.550593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.550492    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.582023 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.581989    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:19.651905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.651784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.651905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.651862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.651905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.651890    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.651942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.651972    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.652011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwq84\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.652064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.652127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.652579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.652157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.653147 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.652955    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.653288 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.653265    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.654218 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.654075    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.654635 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.654595    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.654868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.654825    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.656815 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.656795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.657690 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.657671    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.662073 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.662043    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwq84\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.662438 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.662417    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token\") pod \"e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") " pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:19.762219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:19.762183    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:20.036303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:20.036276    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:29:20.039564 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:29:20.039519    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91dac002_0ed4_4e19_8526_2ebd9bae0a49.slice/crio-078d8d8799091aff5688aa2ed0298c8a10a70d54eda0b7e0e85da9d6e844ab5e WatchSource:0}: Error finding container 078d8d8799091aff5688aa2ed0298c8a10a70d54eda0b7e0e85da9d6e844ab5e: Status 404 returned error can't find the container with id 078d8d8799091aff5688aa2ed0298c8a10a70d54eda0b7e0e85da9d6e844ab5e
Sep 19 01:29:20.041663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:20.041627    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:20.041745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:20.041690    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:20.041745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:20.041719    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:21.018693 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.018659    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerStarted","Data":"3d7a8f3dcdd07512bb0d21fbd23dbade54673265fd9fe427d28fb8f51d0293e1"}
Sep 19 01:29:21.019058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.018716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerStarted","Data":"078d8d8799091aff5688aa2ed0298c8a10a70d54eda0b7e0e85da9d6e844ab5e"}
Sep 19 01:29:21.041523 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.041477    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podStartSLOduration=2.041463685 podStartE2EDuration="2.041463685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:29:21.040823956 +0000 UTC m=+1008.382271880" watchObservedRunningTime="2026-09-19 01:29:21.041463685 +0000 UTC m=+1008.382911607"
Sep 19 01:29:21.763276 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.763242    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:21.768193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.768168    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:21.848868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:21.848827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:22.024026 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:22.023945    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:22.025317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:22.025297    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:22.328573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:22.328540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:23.053532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:23.053494    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:23.259321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:23.259283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:23.710881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:23.710843    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:24.660499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:24.660452    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:24.876470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:24.876440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:25.458105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:25.458065    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.280683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.280647    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:29:26.284874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.284853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.287541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.287514    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-cf0ace-serving-cert\""
Sep 19 01:29:26.294454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.294018    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:29:26.317141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.317102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.319261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.319239    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.319405 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.319385    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.319457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.319439    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.319531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.319515    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq562\" (UniqueName: \"kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.419630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.419598    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.420182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.420157    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.420289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.420274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.420351 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:29:26.420304    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-serving-cert: secret "maas-api-e2e-explicit-cf0ace-serving-cert" not found
Sep 19 01:29:26.420351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.420317    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.420457 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:29:26.420390    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls podName:9c3b62b9-4cef-43a7-a28f-4395bad93d07 nodeName:}" failed. No retries permitted until 2026-09-19 01:29:26.920367905 +0000 UTC m=+1014.261815830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls") pod "maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" (UID: "9c3b62b9-4cef-43a7-a28f-4395bad93d07") : secret "maas-api-e2e-explicit-cf0ace-serving-cert" not found
Sep 19 01:29:26.420457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.420444    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq562\" (UniqueName: \"kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.421108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.421089    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.422888 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.422870    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.430410 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.430389    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq562\" (UniqueName: \"kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.546574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.546492    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.668795 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.668760    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.769183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.769157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:26.925282 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.925201    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:26.927604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:26.927576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") pod \"maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:27.021691 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.021655    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:27.128087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.128050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:27.197940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.197846    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:27.484321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.484293    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:29:27.485822 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:29:27.485795    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3b62b9_4cef_43a7_a28f_4395bad93d07.slice/crio-862490737d0912edb10ec8a521bc3b991502a7e0fbbc6cecc78fc23632b08051 WatchSource:0}: Error finding container 862490737d0912edb10ec8a521bc3b991502a7e0fbbc6cecc78fc23632b08051: Status 404 returned error can't find the container with id 862490737d0912edb10ec8a521bc3b991502a7e0fbbc6cecc78fc23632b08051
Sep 19 01:29:27.905793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.905772    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:27.905909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.905820    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:27.918065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:27.918041    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:28.056584 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:28.056542    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" event={"ID":"9c3b62b9-4cef-43a7-a28f-4395bad93d07","Type":"ContainerStarted","Data":"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"}
Sep 19 01:29:28.056755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:28.056608    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" event={"ID":"9c3b62b9-4cef-43a7-a28f-4395bad93d07","Type":"ContainerStarted","Data":"862490737d0912edb10ec8a521bc3b991502a7e0fbbc6cecc78fc23632b08051"}
Sep 19 01:29:28.056857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:28.056836    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:28.067649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:28.067620    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:29:28.076033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:28.075985    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" podStartSLOduration=1.6866358190000001 podStartE2EDuration="2.075970005s" totalImagesPullingTime="389.334186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:29:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:29:28.073819979 +0000 UTC m=+1015.415267903" watchObservedRunningTime="2026-09-19 01:29:28.075970005 +0000 UTC m=+1015.417417930"
Sep 19 01:29:34.067399 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:34.067369    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:29:37.190166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:37.190127    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:38.091119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:38.091080    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:43.925339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:43.925298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:44.027165 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:44.027125    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:44.126971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:44.126937    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:44.245055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:44.244964    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:44.326697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:44.326652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:44.426653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:44.426619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:45.077819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.077782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:45.153369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.153342    2567 generic.go:356] "Generic (PLEG): container finished" podID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerID="3d7a8f3dcdd07512bb0d21fbd23dbade54673265fd9fe427d28fb8f51d0293e1" exitCode=0
Sep 19 01:29:45.153535 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.153383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerDied","Data":"3d7a8f3dcdd07512bb0d21fbd23dbade54673265fd9fe427d28fb8f51d0293e1"}
Sep 19 01:29:45.153776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.153760    2567 scope.go:117] "RemoveContainer" containerID="3d7a8f3dcdd07512bb0d21fbd23dbade54673265fd9fe427d28fb8f51d0293e1"
Sep 19 01:29:45.154807 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.154779    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:45.154868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.154844    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:45.154905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.154876    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:29:45.178208 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.178182    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:45.275989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:45.275941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:46.160586 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:46.160551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerStarted","Data":"b84abc0490d94b4ccc905087c63c8126e1e8d1f3ad13bd2025d20b366dcde09d"}
Sep 19 01:29:46.763029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:46.762992    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:46.763261 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:46.763239    2567 patch_prober.go:28] interesting pod/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 19 01:29:46.763360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:46.763299    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 19 01:29:46.858080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:46.858046    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:47.762612 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:47.762577    2567 patch_prober.go:28] interesting pod/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 19 01:29:47.763000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:47.762629    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 19 01:29:48.763210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:48.763171    2567 patch_prober.go:28] interesting pod/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 19 01:29:48.763597 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:48.763234    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 19 01:29:49.033875 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:49.033846    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:49.763133 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:49.763095    2567 patch_prober.go:28] interesting pod/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 19 01:29:49.763313 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:49.763158    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 19 01:29:49.835471 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:49.835427    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:50.509977 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:50.509937    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:50.763445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:50.763361    2567 patch_prober.go:28] interesting pod/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 19 01:29:50.763445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:50.763429    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 19 01:29:51.330595 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:51.330553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:51.766778 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:51.766706    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:51.767176 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:51.766955    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:51.767614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:51.767597    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:29:52.055903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:52.055866    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:53.165173 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:53.165136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:53.708054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:53.708016    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:53.912178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:53.912144    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:54.500635 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:54.500603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:29:57.509474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:29:57.509434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:00.151761 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.151729    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"]
Sep 19 01:30:00.155395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.155378    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"
Sep 19 01:30:00.158444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.158425    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7pvt\""
Sep 19 01:30:00.165621 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.165600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"
Sep 19 01:30:00.171222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.171191    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"]
Sep 19 01:30:00.368338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.368307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:00.443640 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.443463    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:00.444803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.444780    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"]
Sep 19 01:30:00.446053 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:30:00.446029    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e0cae9f_d9fd_4c93_b764_7b1cb9896331.slice/crio-42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621 WatchSource:0}: Error finding container 42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621: Status 404 returned error can't find the container with id 42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621
Sep 19 01:30:00.610481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.610436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:00.937754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.937723    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:30:00.943116 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.943097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:00.946414 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.946395    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-728f63f6-openshift-default-dockercfg-8jbgv\""
Sep 19 01:30:00.958863 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.958836    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:30:00.972970 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:00.972945    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:01.058095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058058    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058095    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058221    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058245    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f9k8\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058292    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058425    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058479 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058447    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.058538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.058522    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f9k8\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160063    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160162    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160272    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160298    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160320    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160618    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160658    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160832    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.160908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.160850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.161159 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.161068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.162770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.162739    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.162879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.162772    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.171654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.171631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.171758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.171729    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f9k8\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8\") pod \"e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") " pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.218430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.218357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:01.246805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.246776    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2" event={"ID":"9e0cae9f-d9fd-4c93-b764-7b1cb9896331","Type":"ContainerStarted","Data":"42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621"}
Sep 19 01:30:01.254126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.254101    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:01.547051 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.547024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:30:01.548143 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:30:01.548116    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef62bcd_8427_40bc_8058_54db154a9a43.slice/crio-723243a357c3e9d7a0afa2e8660457cc016962d3689c6e8335ca7baa1f46ea2e WatchSource:0}: Error finding container 723243a357c3e9d7a0afa2e8660457cc016962d3689c6e8335ca7baa1f46ea2e: Status 404 returned error can't find the container with id 723243a357c3e9d7a0afa2e8660457cc016962d3689c6e8335ca7baa1f46ea2e
Sep 19 01:30:01.550506 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.550472    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:01.550603 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.550547    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:01.550603 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:01.550575    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:02.254141 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.254105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerStarted","Data":"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"}
Sep 19 01:30:02.254607 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.254276    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:02.254607 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.254323    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerStarted","Data":"723243a357c3e9d7a0afa2e8660457cc016962d3689c6e8335ca7baa1f46ea2e"}
Sep 19 01:30:02.255748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.255722    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:02.255880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.255776    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:02.279880 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:02.279829    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podStartSLOduration=2.279809873 podStartE2EDuration="2.279809873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:30:02.277285759 +0000 UTC m=+1049.618733674" watchObservedRunningTime="2026-09-19 01:30:02.279809873 +0000 UTC m=+1049.621257801"
Sep 19 01:30:03.259682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:03.259622    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:03.260394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:03.260374    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:03.260950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:03.260911    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:04.269416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:04.269337    2567 generic.go:356] "Generic (PLEG): container finished" podID="9e0cae9f-d9fd-4c93-b764-7b1cb9896331" containerID="34bfc70ea0f2c9156be0442b31591310f10c6e8ded8aaed192ed1962f13f8dc7" exitCode=0
Sep 19 01:30:04.269883 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:04.269420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2" event={"ID":"9e0cae9f-d9fd-4c93-b764-7b1cb9896331","Type":"ContainerDied","Data":"34bfc70ea0f2c9156be0442b31591310f10c6e8ded8aaed192ed1962f13f8dc7"}
Sep 19 01:30:05.406636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:05.406614    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"
Sep 19 01:30:06.279756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:06.279729    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"
Sep 19 01:30:06.279756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:06.279739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2" event={"ID":"9e0cae9f-d9fd-4c93-b764-7b1cb9896331","Type":"ContainerDied","Data":"42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621"}
Sep 19 01:30:06.280039 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:06.279786    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42579273eb2a3f4c68ecc501757c5b078fcdf7d293831d64f626c5dca0e6a621"
Sep 19 01:30:06.820758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:06.820712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:07.620901 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:07.620871    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:07.717306 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:07.717269    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:07.818396 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:07.818356    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:08.542369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:08.542339    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:09.344784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:09.344748    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:10.035439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.035397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:10.868627 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.868597    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:10.869036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.869022    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e0cae9f-d9fd-4c93-b764-7b1cb9896331" containerName="cleanup"
Sep 19 01:30:10.869098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.869038    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0cae9f-d9fd-4c93-b764-7b1cb9896331" containerName="cleanup"
Sep 19 01:30:10.869098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.869097    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e0cae9f-d9fd-4c93-b764-7b1cb9896331" containerName="cleanup"
Sep 19 01:30:10.872211 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.872191    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:10.874947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.874906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-728f63f6-serving-cert\""
Sep 19 01:30:10.884442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.884420    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:10.902065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.902034    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:10.954812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.954785    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztzp6\" (UniqueName: \"kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:10.954953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.954833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:10.955006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.954966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:10.955006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:10.954997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.003430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.003397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:11.056105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.056077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztzp6\" (UniqueName: \"kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.056453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.056138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.056453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.056235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.056453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.056275    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.056453 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:30:11.056372    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-serving-cert: secret "maas-api-e2e-mt-728f63f6-serving-cert" not found
Sep 19 01:30:11.056453 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:30:11.056442    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls podName:3c27936b-4f2f-47b6-9c3c-86c4d09f9b97 nodeName:}" failed. No retries permitted until 2026-09-19 01:30:11.556426548 +0000 UTC m=+1058.897874469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls") pod "maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" (UID: "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97") : secret "maas-api-e2e-mt-728f63f6-serving-cert" not found
Sep 19 01:30:11.056829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.056812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.058763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.058744    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.069727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.069703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztzp6\" (UniqueName: \"kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.191500 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.191420    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:11.386262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.386230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:11.472772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.472682    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:11.562478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.562447    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.564802 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.564778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") pod \"maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:11.785803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:11.785770    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:12.055816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:12.055785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:12.056881 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:30:12.056854    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c27936b_4f2f_47b6_9c3c_86c4d09f9b97.slice/crio-b939f84ee6dfdc6362af6810f5e5cb1788fa56fa63e341fadbb3344d4caafac2 WatchSource:0}: Error finding container b939f84ee6dfdc6362af6810f5e5cb1788fa56fa63e341fadbb3344d4caafac2: Status 404 returned error can't find the container with id b939f84ee6dfdc6362af6810f5e5cb1788fa56fa63e341fadbb3344d4caafac2
Sep 19 01:30:12.310641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:12.310556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" event={"ID":"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97","Type":"ContainerStarted","Data":"b939f84ee6dfdc6362af6810f5e5cb1788fa56fa63e341fadbb3344d4caafac2"}
Sep 19 01:30:13.316822 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:13.316790    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" event={"ID":"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97","Type":"ContainerStarted","Data":"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"}
Sep 19 01:30:13.317304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:13.316853    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:13.358729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:13.358681    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" podStartSLOduration=2.999735235 podStartE2EDuration="3.358666818s" totalImagesPullingTime="358.931583ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:30:13.358093783 +0000 UTC m=+1060.699541706" watchObservedRunningTime="2026-09-19 01:30:13.358666818 +0000 UTC m=+1060.700114745"
Sep 19 01:30:19.327906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:19.327827    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:29.400186 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.400102    2567 generic.go:356] "Generic (PLEG): container finished" podID="aef62bcd-8427-40bc-8058-54db154a9a43" containerID="7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4" exitCode=0
Sep 19 01:30:29.400616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.400178    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerDied","Data":"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"}
Sep 19 01:30:29.400680 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.400660    2567 scope.go:117] "RemoveContainer" containerID="7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"
Sep 19 01:30:29.401959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.401906    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:29.402034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.402017    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:29.402072 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.402050    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:29.857412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:29.857374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:30.410190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:30.410146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerStarted","Data":"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"}
Sep 19 01:30:31.254746 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:31.254708    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:31.255556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:31.255528    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:31.255682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:31.255582    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:32.254903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:32.254865    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:32.255310 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:32.254934    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:33.254928 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:33.254886    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:33.255297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:33.254952    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:33.260197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:33.260178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:33.548481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:33.548440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:34.255017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:34.254978    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:34.255476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:34.255038    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:34.635238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:34.635205    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:34.921164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:34.921027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:35.021803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:35.021767    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:35.254475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:35.254393    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 19 01:30:35.254475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:35.254443    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 19 01:30:35.545010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:35.544967    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:36.259045 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:36.259015    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:36.260065 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:36.260045    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:30:36.273786 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:36.273755    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:37.111412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:37.111380    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:37.554826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:37.554793    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:37.700715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:37.700684    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:38.229473 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:38.229440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:38.363626 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:38.363575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:38.468122 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:38.468078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:38.834908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:38.834877    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:39.482658 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:39.482626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:40.144486 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:40.144448    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:40.835908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:40.835870    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:41.718113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:41.718081    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:42.423251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:42.423222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:45.740361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:45.740328    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:45.807740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:45.807710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:46.344717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:46.344683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:47.225644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.225609    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:47.888825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.888787    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:30:47.889105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.889079    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" podUID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" containerName="maas-api" containerID="cri-o://174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35" gracePeriod=30
Sep 19 01:30:47.927002 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.926961    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:47.932970 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.932890    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"]
Sep 19 01:30:47.935738 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:47.935718    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-cf0ace-29829690-lbgc2"]
Sep 19 01:30:48.041566 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.041487    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:48.131825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.131800    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:30:48.143669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.143600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:48.224684 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.224655    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca\") pod \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") "
Sep 19 01:30:48.224856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.224700    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq562\" (UniqueName: \"kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562\") pod \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") "
Sep 19 01:30:48.224856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.224724    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") pod \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") "
Sep 19 01:30:48.224856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.224753    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs\") pod \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\" (UID: \"9c3b62b9-4cef-43a7-a28f-4395bad93d07\") "
Sep 19 01:30:48.225140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.225108    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9c3b62b9-4cef-43a7-a28f-4395bad93d07" (UID: "9c3b62b9-4cef-43a7-a28f-4395bad93d07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:30:48.225327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.225308    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c3b62b9-4cef-43a7-a28f-4395bad93d07-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:48.226803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.226783    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9c3b62b9-4cef-43a7-a28f-4395bad93d07" (UID: "9c3b62b9-4cef-43a7-a28f-4395bad93d07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:30:48.227335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.227318    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9c3b62b9-4cef-43a7-a28f-4395bad93d07" (UID: "9c3b62b9-4cef-43a7-a28f-4395bad93d07"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:30:48.227410 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.227333    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562" (OuterVolumeSpecName: "kube-api-access-gq562") pod "9c3b62b9-4cef-43a7-a28f-4395bad93d07" (UID: "9c3b62b9-4cef-43a7-a28f-4395bad93d07"). InnerVolumeSpecName "kube-api-access-gq562". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:30:48.254259 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.254214    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:48.329119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.328108    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq562\" (UniqueName: \"kubernetes.io/projected/9c3b62b9-4cef-43a7-a28f-4395bad93d07-kube-api-access-gq562\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:48.329119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.328142    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:48.329119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.328156    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c3b62b9-4cef-43a7-a28f-4395bad93d07-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:48.351177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.351138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:48.508672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.508592    2567 generic.go:356] "Generic (PLEG): container finished" podID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" containerID="174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35" exitCode=0
Sep 19 01:30:48.508672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.508641    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"
Sep 19 01:30:48.508867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.508671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" event={"ID":"9c3b62b9-4cef-43a7-a28f-4395bad93d07","Type":"ContainerDied","Data":"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"}
Sep 19 01:30:48.508867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.508724    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd" event={"ID":"9c3b62b9-4cef-43a7-a28f-4395bad93d07","Type":"ContainerDied","Data":"862490737d0912edb10ec8a521bc3b991502a7e0fbbc6cecc78fc23632b08051"}
Sep 19 01:30:48.508867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.508744    2567 scope.go:117] "RemoveContainer" containerID="174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"
Sep 19 01:30:48.518188 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.518170    2567 scope.go:117] "RemoveContainer" containerID="174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"
Sep 19 01:30:48.518429 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:30:48.518412    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35\": container with ID starting with 174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35 not found: ID does not exist" containerID="174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"
Sep 19 01:30:48.518481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.518437    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35"} err="failed to get container status \"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35\": rpc error: code = NotFound desc = could not find container \"174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35\": container with ID starting with 174a7f405a30b0381eed5bbeff1b735572959927af41c7f8101a287335852e35 not found: ID does not exist"
Sep 19 01:30:48.532798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.532778    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:30:48.538534 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.538513    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-cf0ace-698bbcf445-xrkxd"]
Sep 19 01:30:48.588104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.588073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:48.921229 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.921200    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" path="/var/lib/kubelet/pods/9c3b62b9-4cef-43a7-a28f-4395bad93d07/volumes"
Sep 19 01:30:48.921499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:48.921487    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0cae9f-d9fd-4c93-b764-7b1cb9896331" path="/var/lib/kubelet/pods/9e0cae9f-d9fd-4c93-b764-7b1cb9896331/volumes"
Sep 19 01:30:49.232782 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:49.232698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:50.117724 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:50.117691    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:50.836138 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:50.836103    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:51.589956 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:51.589906    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:52.465485 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:52.465453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:53.661183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:53.661151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:55.164343 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.164303    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:55.241992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.241954    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:55.433985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.433851    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:30:55.434152 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.434120    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy" containerID="cri-o://b84abc0490d94b4ccc905087c63c8126e1e8d1f3ad13bd2025d20b366dcde09d" gracePeriod=30
Sep 19 01:30:55.454267 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.454239    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:55.907854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:55.907820    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:56.216887 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.216804    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:30:56.217359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.217267    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" containerName="maas-api"
Sep 19 01:30:56.217359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.217280    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" containerName="maas-api"
Sep 19 01:30:56.217359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.217354    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c3b62b9-4cef-43a7-a28f-4395bad93d07" containerName="maas-api"
Sep 19 01:30:56.220395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.220375    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.222976 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.222954    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-a136cc-openshift-default-dockercfg-cwxmw\""
Sep 19 01:30:56.234623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.234598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:30:56.247392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.247321    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.307943    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308007    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308036    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308178    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308224    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308258    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.308521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.308284    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v4h7\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409111 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409079    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409120    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409390 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409273    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409390 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4v4h7\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409485    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409518    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409569    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409851 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409778    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.409851 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.409806    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.410262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.410238    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.411556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.411532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.411778 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.411761    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.418312 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.418293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v4h7\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.418394 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.418348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token\") pod \"e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") " pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.439906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.439878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:56.533454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.533424    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:56.668018 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.667988    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:56.821219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.821078    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:30:56.823902 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:30:56.823875    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ca94d1_cf18_4e75_94c4_95a8aaad4978.slice/crio-c22874ca77a3e8bf0c3b539e54ccf947ba625bee66a02117490c2703c9858882 WatchSource:0}: Error finding container c22874ca77a3e8bf0c3b539e54ccf947ba625bee66a02117490c2703c9858882: Status 404 returned error can't find the container with id c22874ca77a3e8bf0c3b539e54ccf947ba625bee66a02117490c2703c9858882
Sep 19 01:30:56.826240 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.826205    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:56.826361 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.826285    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:56.826432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:56.826361    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:30:57.206605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.206510    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:57.206848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.206775    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" podUID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" containerName="maas-api" containerID="cri-o://26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754" gracePeriod=30
Sep 19 01:30:57.239323 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.239291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:57.340291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.340187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:57.438556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.438526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:57.455727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.455708    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:57.538672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.538636    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:57.562148 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.562118    2567 generic.go:356] "Generic (PLEG): container finished" podID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" containerID="26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754" exitCode=0
Sep 19 01:30:57.562289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.562158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"
Sep 19 01:30:57.562289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.562187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" event={"ID":"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97","Type":"ContainerDied","Data":"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"}
Sep 19 01:30:57.562289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.562237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc" event={"ID":"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97","Type":"ContainerDied","Data":"b939f84ee6dfdc6362af6810f5e5cb1788fa56fa63e341fadbb3344d4caafac2"}
Sep 19 01:30:57.562289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.562252    2567 scope.go:117] "RemoveContainer" containerID="26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"
Sep 19 01:30:57.564252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.564224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" event={"ID":"02ca94d1-cf18-4e75-94c4-95a8aaad4978","Type":"ContainerStarted","Data":"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"}
Sep 19 01:30:57.564364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.564281    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" event={"ID":"02ca94d1-cf18-4e75-94c4-95a8aaad4978","Type":"ContainerStarted","Data":"c22874ca77a3e8bf0c3b539e54ccf947ba625bee66a02117490c2703c9858882"}
Sep 19 01:30:57.573235 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.573215    2567 scope.go:117] "RemoveContainer" containerID="26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"
Sep 19 01:30:57.573524 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:30:57.573502    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754\": container with ID starting with 26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754 not found: ID does not exist" containerID="26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"
Sep 19 01:30:57.573617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.573540    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754"} err="failed to get container status \"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754\": rpc error: code = NotFound desc = could not find container \"26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754\": container with ID starting with 26f663c6738c8f6998a6f3b42378fa82a875b447756d74a7b831e5fb2dd77754 not found: ID does not exist"
Sep 19 01:30:57.589336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.589297    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" podStartSLOduration=1.589285565 podStartE2EDuration="1.589285565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:30:57.587849361 +0000 UTC m=+1104.929297299" watchObservedRunningTime="2026-09-19 01:30:57.589285565 +0000 UTC m=+1104.930733487"
Sep 19 01:30:57.624479 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.624456    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs\") pod \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") "
Sep 19 01:30:57.624571 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.624489    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") pod \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") "
Sep 19 01:30:57.624571 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.624550    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca\") pod \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") "
Sep 19 01:30:57.624651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.624606    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztzp6\" (UniqueName: \"kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6\") pod \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\" (UID: \"3c27936b-4f2f-47b6-9c3c-86c4d09f9b97\") "
Sep 19 01:30:57.624943 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.624902    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" (UID: "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:30:57.626583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.626559    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" (UID: "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:30:57.626659 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.626606    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" (UID: "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:30:57.626701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.626656    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6" (OuterVolumeSpecName: "kube-api-access-ztzp6") pod "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" (UID: "3c27936b-4f2f-47b6-9c3c-86c4d09f9b97"). InnerVolumeSpecName "kube-api-access-ztzp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:30:57.726705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.726666    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:57.726705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.726705    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:57.726897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.726719    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztzp6\" (UniqueName: \"kubernetes.io/projected/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-kube-api-access-ztzp6\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:57.726897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.726733    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:30:57.903727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.903694    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:57.908940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.908892    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:57.909683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:57.909664    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-728f63f6-8b8cd8d6b-r77xc"]
Sep 19 01:30:58.020937 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.020890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:58.124983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.124895    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:58.533627 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.533602    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:58.538957 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.538908    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:58.570714 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.570688    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:58.571397 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.571380    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:30:58.912852 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.912773    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:30:58.920492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:58.920466    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" path="/var/lib/kubelet/pods/3c27936b-4f2f-47b6-9c3c-86c4d09f9b97/volumes"
Sep 19 01:30:59.854220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:30:59.854191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:00.584083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.584050    2567 generic.go:356] "Generic (PLEG): container finished" podID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerID="b84abc0490d94b4ccc905087c63c8126e1e8d1f3ad13bd2025d20b366dcde09d" exitCode=0
Sep 19 01:31:00.584271 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.584120    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerDied","Data":"b84abc0490d94b4ccc905087c63c8126e1e8d1f3ad13bd2025d20b366dcde09d"}
Sep 19 01:31:00.584271 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.584174    2567 scope.go:117] "RemoveContainer" containerID="3d7a8f3dcdd07512bb0d21fbd23dbade54673265fd9fe427d28fb8f51d0293e1"
Sep 19 01:31:00.628035 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.627998    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:00.696699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.696640    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:31:00.859781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859788    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859896    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859947    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwq84\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.859996    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860022    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860038    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data" (OuterVolumeSpecName: "istio-data") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860147    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860161    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860217    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket\") pod \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\" (UID: \"91dac002-0ed4-4e19-8526-2ebd9bae0a49\") "
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860351    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860368    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860571    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860640    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860661    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860677    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.860696 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.860689    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.862044 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.862016    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:00.862234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.862215    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token" (OuterVolumeSpecName: "istio-token") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:00.862655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.862631    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:31:00.862655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.862641    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84" (OuterVolumeSpecName: "kube-api-access-gwq84") pod "91dac002-0ed4-4e19-8526-2ebd9bae0a49" (UID: "91dac002-0ed4-4e19-8526-2ebd9bae0a49"). InnerVolumeSpecName "kube-api-access-gwq84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:00.962177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.962116    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.962177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.962139    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.962177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.962147    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.962177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.962156    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91dac002-0ed4-4e19-8526-2ebd9bae0a49-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:00.962177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:00.962165    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwq84\" (UniqueName: \"kubernetes.io/projected/91dac002-0ed4-4e19-8526-2ebd9bae0a49-kube-api-access-gwq84\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:01.590219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:01.590187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm" event={"ID":"91dac002-0ed4-4e19-8526-2ebd9bae0a49","Type":"ContainerDied","Data":"078d8d8799091aff5688aa2ed0298c8a10a70d54eda0b7e0e85da9d6e844ab5e"}
Sep 19 01:31:01.590219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:01.590207    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"
Sep 19 01:31:01.590437 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:01.590244    2567 scope.go:117] "RemoveContainer" containerID="b84abc0490d94b4ccc905087c63c8126e1e8d1f3ad13bd2025d20b366dcde09d"
Sep 19 01:31:01.611245 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:01.611221    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:31:01.614927 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:01.614897    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-cf0ace-openshift-default-7f6884ff8d-8zqcm"]
Sep 19 01:31:02.920937 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:02.920889    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" path="/var/lib/kubelet/pods/91dac002-0ed4-4e19-8526-2ebd9bae0a49/volumes"
Sep 19 01:31:04.486523 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:04.486486    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:04.587889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:04.587856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:04.804055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:04.804018    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:31:04.804263 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:04.804223    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" containerID="cri-o://96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97" gracePeriod=30
Sep 19 01:31:04.860467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:04.860436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:05.180966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:05.180867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:05.288393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:05.288358    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:05.406146 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:05.406108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:06.261453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:06.261423    2567 patch_prober.go:28] interesting pod/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 01:31:06.261829 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:06.261476    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 01:31:10.074322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.074264    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:31:10.143868 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.143834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f9k8\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.143879    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.143899    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.143932    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.143980    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144098    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144141    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144177    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144200    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy\") pod \"aef62bcd-8427-40bc-8058-54db154a9a43\" (UID: \"aef62bcd-8427-40bc-8058-54db154a9a43\") "
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144255    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:10.144295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144272    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data" (OuterVolumeSpecName: "istio-data") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:10.144604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144361    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:10.144604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144448    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:10.144701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144667    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:31:10.144752 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144716    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.144752 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144736    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.144856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144751    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.144856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.144764    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.146283 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.146249    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8" (OuterVolumeSpecName: "kube-api-access-5f9k8") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "kube-api-access-5f9k8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:10.146515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.146489    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:31:10.146593 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.146577    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token" (OuterVolumeSpecName: "istio-token") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:10.146640 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.146618    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aef62bcd-8427-40bc-8058-54db154a9a43" (UID: "aef62bcd-8427-40bc-8058-54db154a9a43"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:10.245617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.245575    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f9k8\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-kube-api-access-5f9k8\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.245617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.245602    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aef62bcd-8427-40bc-8058-54db154a9a43-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.245617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.245611    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aef62bcd-8427-40bc-8058-54db154a9a43-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.245617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.245621    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aef62bcd-8427-40bc-8058-54db154a9a43-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.245617 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.245630    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aef62bcd-8427-40bc-8058-54db154a9a43-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:10.636783 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.636751    2567 generic.go:356] "Generic (PLEG): container finished" podID="aef62bcd-8427-40bc-8058-54db154a9a43" containerID="96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97" exitCode=0
Sep 19 01:31:10.636783 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.636787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerDied","Data":"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"}
Sep 19 01:31:10.637037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.636798    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"
Sep 19 01:31:10.637037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.636828    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8" event={"ID":"aef62bcd-8427-40bc-8058-54db154a9a43","Type":"ContainerDied","Data":"723243a357c3e9d7a0afa2e8660457cc016962d3689c6e8335ca7baa1f46ea2e"}
Sep 19 01:31:10.637037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.636849    2567 scope.go:117] "RemoveContainer" containerID="96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"
Sep 19 01:31:10.646419 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.646400    2567 scope.go:117] "RemoveContainer" containerID="7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"
Sep 19 01:31:10.656498 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.656482    2567 scope.go:117] "RemoveContainer" containerID="96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"
Sep 19 01:31:10.656742 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:31:10.656722    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97\": container with ID starting with 96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97 not found: ID does not exist" containerID="96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"
Sep 19 01:31:10.656810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.656749    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97"} err="failed to get container status \"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97\": rpc error: code = NotFound desc = could not find container \"96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97\": container with ID starting with 96a4c2dfe0dd50014ab6fc152fc9cd2a4e4237b96fb220e908b683c21e3d5e97 not found: ID does not exist"
Sep 19 01:31:10.656810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.656764    2567 scope.go:117] "RemoveContainer" containerID="7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"
Sep 19 01:31:10.657046 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:31:10.657028    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4\": container with ID starting with 7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4 not found: ID does not exist" containerID="7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"
Sep 19 01:31:10.657135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.657052    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4"} err="failed to get container status \"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4\": rpc error: code = NotFound desc = could not find container \"7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4\": container with ID starting with 7aa2b40c653770be8266263121a815dd34400e83d36ba154fe2359cfa19a27a4 not found: ID does not exist"
Sep 19 01:31:10.659861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.659837    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:31:10.663933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.663899    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-728f63f6-openshift-default-56b9895f68-98vw8"]
Sep 19 01:31:10.828719 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.828687    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:10.921254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:10.921182    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" path="/var/lib/kubelet/pods/aef62bcd-8427-40bc-8058-54db154a9a43/volumes"
Sep 19 01:31:11.763326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:11.763292    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:11.825614 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:11.825582    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:11.911233 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:11.911204    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:12.011256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:12.011217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:12.131532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:12.131502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:15.120276 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:15.120243    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:17.766381 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:17.766348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:18.419531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:18.419495    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:18.521449 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:18.521414    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:19.384575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.384539    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:19.674245 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674173    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:31:19.674566 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674554    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674567    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674578    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674584    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674596    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674602    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:19.674608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674609    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" containerName="maas-api"
Sep 19 01:31:19.674793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674614    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" containerName="maas-api"
Sep 19 01:31:19.674793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674683    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:19.674793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674689    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:19.674793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674697    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:19.674793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.674704    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c27936b-4f2f-47b6-9c3c-86c4d09f9b97" containerName="maas-api"
Sep 19 01:31:19.679415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.679394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.682133 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.682112    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-10325b-openshift-default-dockercfg-4fjhq\""
Sep 19 01:31:19.692478 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.692455    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:31:19.705957 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.705888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:19.733794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733772    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.733904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.733904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.733904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.734055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733933    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.734055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jscmj\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.734055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.733975    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.734055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.734031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.734196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.734075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835231    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jscmj\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835685 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835406    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835685 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835441    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835685 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835579    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.835862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.835788    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.836102 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.836078    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.836206 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.836160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.836259 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.836206    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.837657 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.837631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.837849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.837831    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.843127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.843101    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.843475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.843456    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jscmj\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj\") pod \"e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") " pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:19.991371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:19.991294    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:20.257888 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.257810    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:20.273653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.273631    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:31:20.275398 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:20.275373    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa97960_18d9_4b81_bd14_aa80c2b0097a.slice/crio-97e39547397c46485c14712472c02d4cad7137526734f9505440b1c12114dd17 WatchSource:0}: Error finding container 97e39547397c46485c14712472c02d4cad7137526734f9505440b1c12114dd17: Status 404 returned error can't find the container with id 97e39547397c46485c14712472c02d4cad7137526734f9505440b1c12114dd17
Sep 19 01:31:20.277978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.277948    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:20.278052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.278016    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:20.278052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.278048    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:20.688297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.688256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerStarted","Data":"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"}
Sep 19 01:31:20.688654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.688316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerStarted","Data":"97e39547397c46485c14712472c02d4cad7137526734f9505440b1c12114dd17"}
Sep 19 01:31:20.710813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.710757    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podStartSLOduration=1.7107380079999999 podStartE2EDuration="1.710738008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:20.709853667 +0000 UTC m=+1128.051301590" watchObservedRunningTime="2026-09-19 01:31:20.710738008 +0000 UTC m=+1128.052185931"
Sep 19 01:31:20.991546 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:20.991472    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:21.998159 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:21.998132    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:22.442847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:22.442809    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:22.684264 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:22.684232    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:22.698207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:22.698144    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:22.699157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:22.699138    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:22.780359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:22.780326    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:23.289553 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:23.289514    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:24.031506 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:24.031475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:24.964060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:24.964020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:25.063367 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.063331    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:25.201301 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.201267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:25.552703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.552661    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:25.649809 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.649775    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:25.692805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.692779    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:31:25.693202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.693188    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:25.693257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.693203    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aef62bcd-8427-40bc-8058-54db154a9a43" containerName="istio-proxy"
Sep 19 01:31:25.693293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.693262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="91dac002-0ed4-4e19-8526-2ebd9bae0a49" containerName="istio-proxy"
Sep 19 01:31:25.696248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.696233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.698854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.698832    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-10325b\""
Sep 19 01:31:25.699000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.698833    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-10325b-dockercfg-v64fc\""
Sep 19 01:31:25.705907 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.705879    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:31:25.796996 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.796948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.797187 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.797018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hbfn\" (UniqueName: \"kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.898002 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.897888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.898002 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.897971    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hbfn\" (UniqueName: \"kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.898644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.898617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:25.907134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:25.907113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hbfn\" (UniqueName: \"kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn\") pod \"payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:26.009000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:26.008979    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:26.284562 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:26.284530    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:31:26.288112 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:26.288072    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fb3793_b499_4e98_9ca0_52e463dbbcf9.slice/crio-c3771f8f61a23c43647f7e49852a6b74f430fc0a5f932583757ed42ab0c35f56 WatchSource:0}: Error finding container c3771f8f61a23c43647f7e49852a6b74f430fc0a5f932583757ed42ab0c35f56: Status 404 returned error can't find the container with id c3771f8f61a23c43647f7e49852a6b74f430fc0a5f932583757ed42ab0c35f56
Sep 19 01:31:26.291317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:26.290659    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 01:31:26.719865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:26.719785    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" event={"ID":"b7fb3793-b499-4e98-9ca0-52e463dbbcf9","Type":"ContainerStarted","Data":"c3771f8f61a23c43647f7e49852a6b74f430fc0a5f932583757ed42ab0c35f56"}
Sep 19 01:31:29.740173 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:29.740139    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" event={"ID":"b7fb3793-b499-4e98-9ca0-52e463dbbcf9","Type":"ContainerStarted","Data":"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"}
Sep 19 01:31:29.740519 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:29.740244    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:29.761748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:29.761703    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" podStartSLOduration=2.173677861 podStartE2EDuration="4.761690012s" totalImagesPullingTime="2.588012151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:29.758983358 +0000 UTC m=+1137.100431281" watchObservedRunningTime="2026-09-19 01:31:29.761690012 +0000 UTC m=+1137.103137934"
Sep 19 01:31:40.747705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:40.747679    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:31:40.951475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:40.951381    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:43.813906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.813875    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerID="5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7" exitCode=0
Sep 19 01:31:43.814333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.813952    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerDied","Data":"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"}
Sep 19 01:31:43.814385 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.814371    2567 scope.go:117] "RemoveContainer" containerID="5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"
Sep 19 01:31:43.815525 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.815500    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:43.815578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.815565    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:43.815625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:43.815613    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:44.821011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:44.820977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerStarted","Data":"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"}
Sep 19 01:31:44.991714 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:44.991682    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:44.991878 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:44.991848    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:44.991941 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:44.991891    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:45.288781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.288750    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:31:45.289009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.288986    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" podUID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" containerName="istio-proxy" containerID="cri-o://e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1" gracePeriod=30
Sep 19 01:31:45.307340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.307310    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:45.549392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.549303    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:45.680079 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.680045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:45.991853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.991772    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:45.991853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:45.991838    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:46.464169 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:46.464133    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:46.992472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:46.992440    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:46.992846 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:46.992488    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:47.724558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:47.724514    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:47.992061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:47.991978    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:47.992061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:47.992035    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:48.139644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.139606    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:48.241743 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.241706    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:48.514883 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.514846    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:31:48.522494 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.522469    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.526104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.526081    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-0376cd-openshift-default-dockercfg-z9txw\""
Sep 19 01:31:48.542946 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.542489    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:31:48.578718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.578688    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:48.646497 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.646460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9ln7\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.646763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.646740    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.646891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.646874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.647105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.647087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.647345 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.647328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.647482 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.647468    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.647660 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.647646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.655035 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.655008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.655265 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.655247    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.756648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.756847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.756847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756724    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9ln7\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.756847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756769    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.756847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756794    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.757121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.757121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.757121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.756983    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.757121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.757061    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.757587 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.757557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.758033 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.758005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.758197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.758016    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.758197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.758171    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.758314 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.758204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.760235 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.760212    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.760557 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.760534    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.768959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.768879    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.769398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.769376    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9ln7\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7\") pod \"e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") " pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.796182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.796155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:48.844186 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.844157    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:48.992313 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.992276    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:48.992457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:48.992342    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:49.144552 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.144405    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:31:49.147005 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:49.146967    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb5cd9b_8da3_4324_adf9_fdc6069debf7.slice/crio-268d885e9bc1a2a558ce1036afcc72ad13eecf6801f4b63ba4baf91f326ee998 WatchSource:0}: Error finding container 268d885e9bc1a2a558ce1036afcc72ad13eecf6801f4b63ba4baf91f326ee998: Status 404 returned error can't find the container with id 268d885e9bc1a2a558ce1036afcc72ad13eecf6801f4b63ba4baf91f326ee998
Sep 19 01:31:49.149803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.149769    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:49.149898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.149838    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:49.149898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.149865    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:31:49.363904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.363869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:49.847604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.847572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerStarted","Data":"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"}
Sep 19 01:31:49.847769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.847626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerStarted","Data":"268d885e9bc1a2a558ce1036afcc72ad13eecf6801f4b63ba4baf91f326ee998"}
Sep 19 01:31:49.872726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.872681    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podStartSLOduration=1.87266567 podStartE2EDuration="1.87266567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:49.870200297 +0000 UTC m=+1157.211648220" watchObservedRunningTime="2026-09-19 01:31:49.87266567 +0000 UTC m=+1157.214113594"
Sep 19 01:31:49.991987 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.991947    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 19 01:31:49.992223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:49.992013    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 19 01:31:50.240171 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.240082    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:50.554182 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.554158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:31:50.675881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.675838    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.675889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.675930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4v4h7\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.675978    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676010    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676059    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676112    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676147    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676176    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data" (OuterVolumeSpecName: "istio-data") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:50.676362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676194    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy\") pod \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\" (UID: \"02ca94d1-cf18-4e75-94c4-95a8aaad4978\") "
Sep 19 01:31:50.676362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676318    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:50.676777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676614    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.676777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676639    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.676777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676739    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:50.677469 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.676910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:50.677469 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.677150    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:31:50.678641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.678613    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7" (OuterVolumeSpecName: "kube-api-access-4v4h7") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "kube-api-access-4v4h7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:50.678751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.678711    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token" (OuterVolumeSpecName: "istio-token") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:31:50.678797 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.678768    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:31:50.678853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.678839    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02ca94d1-cf18-4e75-94c4-95a8aaad4978" (UID: "02ca94d1-cf18-4e75-94c4-95a8aaad4978"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:31:50.772337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.772287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:50.777651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777616    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777653    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4v4h7\" (UniqueName: \"kubernetes.io/projected/02ca94d1-cf18-4e75-94c4-95a8aaad4978-kube-api-access-4v4h7\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777672    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777683    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777696    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777709    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.777798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.777721    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02ca94d1-cf18-4e75-94c4-95a8aaad4978-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:31:50.844570 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.844492    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:50.849630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.849606    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:50.854113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854089    2567 generic.go:356] "Generic (PLEG): container finished" podID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" containerID="e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1" exitCode=0
Sep 19 01:31:50.854225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854151    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"
Sep 19 01:31:50.854225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854175    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" event={"ID":"02ca94d1-cf18-4e75-94c4-95a8aaad4978","Type":"ContainerDied","Data":"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"}
Sep 19 01:31:50.854225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854220    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j" event={"ID":"02ca94d1-cf18-4e75-94c4-95a8aaad4978","Type":"ContainerDied","Data":"c22874ca77a3e8bf0c3b539e54ccf947ba625bee66a02117490c2703c9858882"}
Sep 19 01:31:50.854336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854249    2567 scope.go:117] "RemoveContainer" containerID="e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"
Sep 19 01:31:50.854574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.854537    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:50.855534 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.855518    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:31:50.863515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.863500    2567 scope.go:117] "RemoveContainer" containerID="e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"
Sep 19 01:31:50.863769 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:31:50.863754    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1\": container with ID starting with e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1 not found: ID does not exist" containerID="e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"
Sep 19 01:31:50.863818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.863775    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1"} err="failed to get container status \"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1\": rpc error: code = NotFound desc = could not find container \"e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1\": container with ID starting with e8dcb3d9d943e051815bb50672ac1aa4bcb1eb398477dab112650e044f7024a1 not found: ID does not exist"
Sep 19 01:31:50.895097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.895074    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:31:50.899950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.899929    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-a136cc-openshift-default-7cc77f858-zzh8j"]
Sep 19 01:31:50.922087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.922067    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" path="/var/lib/kubelet/pods/02ca94d1-cf18-4e75-94c4-95a8aaad4978/volumes"
Sep 19 01:31:50.995631 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.995604    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:50.995962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.995944    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:50.996788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:50.996767    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:31:51.236963 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:51.236862    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:52.046294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:52.046207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:52.142661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:52.142625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:53.054143 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:53.054108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:53.288667 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:53.288639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:54.222964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:54.222911    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:54.973889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:54.973850    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:55.787379 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.787346    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:31:55.787990 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.787975    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" containerName="istio-proxy"
Sep 19 01:31:55.788036 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.787993    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" containerName="istio-proxy"
Sep 19 01:31:55.788109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.788097    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="02ca94d1-cf18-4e75-94c4-95a8aaad4978" containerName="istio-proxy"
Sep 19 01:31:55.791739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.791711    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:55.794531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.794509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-0376cd-serving-cert\""
Sep 19 01:31:55.803044 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.803018    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:31:55.841408 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.841378    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:55.927237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.927206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7j66\" (UniqueName: \"kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:55.927237 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.927241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:55.927496 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.927323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:55.927496 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.927402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:55.997134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:55.997096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:56.028180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.028154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.028317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.028225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7j66\" (UniqueName: \"kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.028317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.028244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.028766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.028733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.029044 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.029020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.030673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.030653    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.031108 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.031090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.050623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.050570    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7j66\" (UniqueName: \"kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66\") pod \"maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.106460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.106436    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.125973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.125941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:56.389291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.389267    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:31:56.391270 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:56.391241    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb357433_fad5_4d1c_841e_42d8b0b3f4f6.slice/crio-88b0ecd2a480cc0a7f05d15db3b732a02e7a4c4d00f82801d1fd178553477690 WatchSource:0}: Error finding container 88b0ecd2a480cc0a7f05d15db3b732a02e7a4c4d00f82801d1fd178553477690: Status 404 returned error can't find the container with id 88b0ecd2a480cc0a7f05d15db3b732a02e7a4c4d00f82801d1fd178553477690
Sep 19 01:31:56.414877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.414847    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:56.515776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.515746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:31:56.524177 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.524149    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:31:56.529356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.529335    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.531909 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.531889    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-0376cd\""
Sep 19 01:31:56.540736 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.540715    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:31:56.546296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.546273    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:31:56.550322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.549939    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.553769 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.553747    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-0376cd-dockercfg-dbg4p\""
Sep 19 01:31:56.560045 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.560022    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:31:56.636327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.636280    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z54wf\" (UniqueName: \"kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.636693 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.636502    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4r9q\" (UniqueName: \"kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.636693 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.636543    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.636693 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.636580    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.738056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.738035    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4r9q\" (UniqueName: \"kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.738154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.738069    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.738154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.738093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.738154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.738115    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z54wf\" (UniqueName: \"kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.739010 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.738984    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.739097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.739049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.746391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.746355    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z54wf\" (UniqueName: \"kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf\") pod \"payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.746508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.746409    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4r9q\" (UniqueName: \"kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q\") pod \"payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.840842 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.840811    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:56.861001 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.860980    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:56.930017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.929848    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:31:56.930017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.929943    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" event={"ID":"fb357433-fad5-4d1c-841e-42d8b0b3f4f6","Type":"ContainerStarted","Data":"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"}
Sep 19 01:31:56.930017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.929976    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" event={"ID":"fb357433-fad5-4d1c-841e-42d8b0b3f4f6","Type":"ContainerStarted","Data":"88b0ecd2a480cc0a7f05d15db3b732a02e7a4c4d00f82801d1fd178553477690"}
Sep 19 01:31:56.945750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:56.945694    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" podStartSLOduration=1.657066494 podStartE2EDuration="1.94568001s" totalImagesPullingTime="288.613516ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:56.942770651 +0000 UTC m=+1164.284218576" watchObservedRunningTime="2026-09-19 01:31:56.94568001 +0000 UTC m=+1164.287127972"
Sep 19 01:31:57.116423 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.116398    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:31:57.118419 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:57.118387    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c99a99c_0d54_464b_9887_d3936dd200b6.slice/crio-744a8df7b58e31000b933a1caaa40bb5cfe0d05225d5c8b894813a5958c10daa WatchSource:0}: Error finding container 744a8df7b58e31000b933a1caaa40bb5cfe0d05225d5c8b894813a5958c10daa: Status 404 returned error can't find the container with id 744a8df7b58e31000b933a1caaa40bb5cfe0d05225d5c8b894813a5958c10daa
Sep 19 01:31:57.146785 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.146766    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:31:57.165045 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:31:57.165018    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f69691_7093_4e3b_ac64_5a19346fc709.slice/crio-103cb04a60cfc9c784d9dd117b710e198538ffdd1095f0376d9669b5ca38bb7c WatchSource:0}: Error finding container 103cb04a60cfc9c784d9dd117b710e198538ffdd1095f0376d9669b5ca38bb7c: Status 404 returned error can't find the container with id 103cb04a60cfc9c784d9dd117b710e198538ffdd1095f0376d9669b5ca38bb7c
Sep 19 01:31:57.930508 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.930475    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" event={"ID":"88f69691-7093-4e3b-ac64-5a19346fc709","Type":"ContainerStarted","Data":"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"}
Sep 19 01:31:57.931005 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.930523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" event={"ID":"88f69691-7093-4e3b-ac64-5a19346fc709","Type":"ContainerStarted","Data":"103cb04a60cfc9c784d9dd117b710e198538ffdd1095f0376d9669b5ca38bb7c"}
Sep 19 01:31:57.931005 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.930553    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:31:57.932155 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.932129    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" event={"ID":"2c99a99c-0d54-464b-9887-d3936dd200b6","Type":"ContainerStarted","Data":"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"}
Sep 19 01:31:57.932260 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.932181    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" event={"ID":"2c99a99c-0d54-464b-9887-d3936dd200b6","Type":"ContainerStarted","Data":"744a8df7b58e31000b933a1caaa40bb5cfe0d05225d5c8b894813a5958c10daa"}
Sep 19 01:31:57.932316 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.932276    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:31:57.956629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.956584    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" podStartSLOduration=1.9565715479999999 podStartE2EDuration="1.956571548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:57.954054565 +0000 UTC m=+1165.295502489" watchObservedRunningTime="2026-09-19 01:31:57.956571548 +0000 UTC m=+1165.298019471"
Sep 19 01:31:57.978077 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:31:57.978038    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" podStartSLOduration=1.978025114 podStartE2EDuration="1.978025114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:31:57.975693681 +0000 UTC m=+1165.317141604" watchObservedRunningTime="2026-09-19 01:31:57.978025114 +0000 UTC m=+1165.319473036"
Sep 19 01:32:03.942456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:03.942422    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:32:06.054030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:06.053989    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:08.939861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:08.939832    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:32:08.940291 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:08.939970    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:32:09.294137 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:09.294104    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:11.697477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:11.697433    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:12.099197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:12.099153    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:12.425315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:12.425219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:13.190633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:13.190593    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:14.047545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:14.047511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:14.822798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:14.822764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:15.896796 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:15.896760    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:16.818606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:16.818569    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:16.926740 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:16.926704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:17.777974 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:17.777901    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:19.136435 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:19.136364    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:20.036265 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:20.036211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:20.989735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:20.989702    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:22.387027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:22.386986    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.134406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.134367    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:32:23.134670 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.134638    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" podUID="5244d18a-1cca-4efc-9d7d-4122e1923188" containerName="maas-api" containerID="cri-o://9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac" gracePeriod=30
Sep 19 01:32:23.173476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.173445    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.267738 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.267705    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.363354 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.363321    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.416586 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.414504    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:32:23.484098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.484062    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.506538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.503752    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls\") pod \"5244d18a-1cca-4efc-9d7d-4122e1923188\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") "
Sep 19 01:32:23.506538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.503829    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca\") pod \"5244d18a-1cca-4efc-9d7d-4122e1923188\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") "
Sep 19 01:32:23.506538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.503871    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvlqn\" (UniqueName: \"kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn\") pod \"5244d18a-1cca-4efc-9d7d-4122e1923188\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") "
Sep 19 01:32:23.506538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.503910    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs\") pod \"5244d18a-1cca-4efc-9d7d-4122e1923188\" (UID: \"5244d18a-1cca-4efc-9d7d-4122e1923188\") "
Sep 19 01:32:23.506538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.506267    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5244d18a-1cca-4efc-9d7d-4122e1923188" (UID: "5244d18a-1cca-4efc-9d7d-4122e1923188"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:32:23.508356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.507811    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5244d18a-1cca-4efc-9d7d-4122e1923188" (UID: "5244d18a-1cca-4efc-9d7d-4122e1923188"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:32:23.511050 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.510020    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn" (OuterVolumeSpecName: "kube-api-access-kvlqn") pod "5244d18a-1cca-4efc-9d7d-4122e1923188" (UID: "5244d18a-1cca-4efc-9d7d-4122e1923188"). InnerVolumeSpecName "kube-api-access-kvlqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:32:23.512770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.512701    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5244d18a-1cca-4efc-9d7d-4122e1923188" (UID: "5244d18a-1cca-4efc-9d7d-4122e1923188"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:32:23.575336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.575294    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.605242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.605215    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:32:23.605242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.605241    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5244d18a-1cca-4efc-9d7d-4122e1923188-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:32:23.605242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.605251    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvlqn\" (UniqueName: \"kubernetes.io/projected/5244d18a-1cca-4efc-9d7d-4122e1923188-kube-api-access-kvlqn\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:32:23.605477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.605259    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5244d18a-1cca-4efc-9d7d-4122e1923188-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:32:23.899393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.899358    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:23.998427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:23.998378    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:24.070588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.070550    2567 generic.go:356] "Generic (PLEG): container finished" podID="5244d18a-1cca-4efc-9d7d-4122e1923188" containerID="9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac" exitCode=0
Sep 19 01:32:24.070750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.070616    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"
Sep 19 01:32:24.070750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.070638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" event={"ID":"5244d18a-1cca-4efc-9d7d-4122e1923188","Type":"ContainerDied","Data":"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"}
Sep 19 01:32:24.070750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.070698    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh" event={"ID":"5244d18a-1cca-4efc-9d7d-4122e1923188","Type":"ContainerDied","Data":"8b5f45fbc8f510371e81960f2e905c82391caaba37d519a673a7740e6ae00e5a"}
Sep 19 01:32:24.070750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.070726    2567 scope.go:117] "RemoveContainer" containerID="9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"
Sep 19 01:32:24.080798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.080777    2567 scope.go:117] "RemoveContainer" containerID="9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"
Sep 19 01:32:24.081098 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:32:24.081080    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac\": container with ID starting with 9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac not found: ID does not exist" containerID="9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"
Sep 19 01:32:24.081160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.081108    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac"} err="failed to get container status \"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac\": rpc error: code = NotFound desc = could not find container \"9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac\": container with ID starting with 9436b82b594bdf6be42406982dfed89ebb7ffa32aa3e0a4715dfafef06ffbaac not found: ID does not exist"
Sep 19 01:32:24.097066 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.097045    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:32:24.100162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.100139    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c4ce82-79d987f4d5-fchvh"]
Sep 19 01:32:24.815434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.815401    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:24.921422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:24.921388    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5244d18a-1cca-4efc-9d7d-4122e1923188" path="/var/lib/kubelet/pods/5244d18a-1cca-4efc-9d7d-4122e1923188/volumes"
Sep 19 01:32:25.078178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.078107    2567 generic.go:356] "Generic (PLEG): container finished" podID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerID="24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66" exitCode=0
Sep 19 01:32:25.078318 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.078183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerDied","Data":"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"}
Sep 19 01:32:25.078637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.078620    2567 scope.go:117] "RemoveContainer" containerID="24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"
Sep 19 01:32:25.079813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.079783    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:32:25.079877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.079853    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:32:25.079936 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.079891    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:32:25.705676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.705636    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:25.956517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:25.956429    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:26.086248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.086218    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerStarted","Data":"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"}
Sep 19 01:32:26.372380 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.372338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:26.552860 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.552824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:26.773486 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.773388    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:26.844309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.844278    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:32:26.844483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.844462    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 19 01:32:26.844531 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:26.844511    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 19 01:32:27.739906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:27.739863    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:27.844739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:27.844702    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 19 01:32:27.844939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:27.844765    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 19 01:32:28.844516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:28.844479    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 19 01:32:28.844886 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:28.844541    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 19 01:32:29.517939 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:29.512999    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:29.708940 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:29.708530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:29.821447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:29.821406    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:29.845121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:29.845071    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 19 01:32:29.845439 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:29.845146    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 19 01:32:30.548052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:30.548022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:30.844849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:30.844765    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 19 01:32:30.844849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:30.844822    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 19 01:32:31.449543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:31.449506    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:31.568107 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:31.568067    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:31.849634 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:31.849608    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:32:31.849934 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:31.849893    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:32:31.850644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:31.850627    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:32:32.022251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:32.022224    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:32.130024 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:32.129933    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:32.295935 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:32.295874    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:32.396660 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:32.396565    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:33.291370 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:33.291327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.034172 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.034137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.121430 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.121398    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.300377 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.300302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.648391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.648314    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.751327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.751292    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:34.794438 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.794410    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:32:34.794867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.794855    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5244d18a-1cca-4efc-9d7d-4122e1923188" containerName="maas-api"
Sep 19 01:32:34.794867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.794868    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="5244d18a-1cca-4efc-9d7d-4122e1923188" containerName="maas-api"
Sep 19 01:32:34.794966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.794959    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="5244d18a-1cca-4efc-9d7d-4122e1923188" containerName="maas-api"
Sep 19 01:32:34.797580 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.797566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:34.801320 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.801302    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b5fe4519\""
Sep 19 01:32:34.801403 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.801343    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b5fe4519-dockercfg-8rnjt\""
Sep 19 01:32:34.809965 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.809941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:32:34.925034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.924955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkm8s\" (UniqueName: \"kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:34.925196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.925034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:34.945054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.945033    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:32:34.946785 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:34.946768    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:32:35.025708 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.025682    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:35.025820 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.025766    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkm8s\" (UniqueName: \"kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:35.026324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.026305    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:35.034207 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.034184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkm8s\" (UniqueName: \"kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s\") pod \"payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") " pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:35.108379 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.108354    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:35.241367 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.241286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:35.377770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.377742    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:32:35.379686 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:32:35.379656    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8944cbad_e2d2_4c2a_ac4d_d3c0384b918a.slice/crio-d2d2e57ebae5d2d80d54c7305978734cfc96e6d8f49aa75d8254684ed790917b WatchSource:0}: Error finding container d2d2e57ebae5d2d80d54c7305978734cfc96e6d8f49aa75d8254684ed790917b: Status 404 returned error can't find the container with id d2d2e57ebae5d2d80d54c7305978734cfc96e6d8f49aa75d8254684ed790917b
Sep 19 01:32:35.945816 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:35.945781    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:36.162592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:36.162556    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" event={"ID":"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a","Type":"ContainerStarted","Data":"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"}
Sep 19 01:32:36.162803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:36.162615    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" event={"ID":"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a","Type":"ContainerStarted","Data":"d2d2e57ebae5d2d80d54c7305978734cfc96e6d8f49aa75d8254684ed790917b"}
Sep 19 01:32:36.162803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:36.162737    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:36.181281 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:36.181229    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" podStartSLOduration=2.18120997 podStartE2EDuration="2.18120997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:32:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:32:36.180373946 +0000 UTC m=+1203.521821870" watchObservedRunningTime="2026-09-19 01:32:36.18120997 +0000 UTC m=+1203.522657896"
Sep 19 01:32:36.644225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:36.644186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:37.332432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:37.332399    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:38.040322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:38.040282    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:38.823250 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:38.823214    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:39.531162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:39.531123    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:42.910711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:42.910662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:43.809399 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:43.809364    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:43.956624 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:43.956584    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:44.103544 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:44.103436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:44.303324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:44.303289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:44.493949 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:44.493827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:44.724375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:44.724336    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:44.909360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:44.909305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:45.099005 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:45.098969    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:46.296315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:46.296280    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:47.169872 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:47.169845    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:32:47.398376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:47.398343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:48.737567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:48.737526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:49.875132 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:49.875102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:50.559675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:50.559636    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:51.366767 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:51.366731    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:51.470432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:51.470394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:51.699873 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:51.699787    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:52.160820 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:52.160785    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:52.441120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:52.441031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:52.826134 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:52.826092    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:53.007506 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:53.007470    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:53.320744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:53.320712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:54.190121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:54.190091    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:54.712897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:54.712855    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:55.134231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:55.134186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:55.783862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:55.783814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:55.877877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:55.877847    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:56.089870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:56.089791    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:56.197321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:56.197288    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:57.081484 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:57.081454    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:57.935127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:57.935086    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:32:58.977834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:32:58.977798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:00.331189 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:00.331140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:00.483965 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:00.483927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:00.589335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:00.589244    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:01.235075 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:01.235020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:01.368315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:01.368282    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:02.033532 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:02.033492    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:03.075445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:03.075408    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:18.808203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:18.808128    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:25.438351 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:25.438311    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:25.916413 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:25.916379    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:26.424825 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.424790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:26.755669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.755589    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:33:26.758225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.758201    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.769650 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.769627    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-bebef4-openshift-default-dockercfg-8bqd4\""
Sep 19 01:33:26.776583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.776560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:33:26.795256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.795229    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:26.907469 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907431    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907550    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907644    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907680    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907713    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907779    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907834 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907817    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl7mr\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.907937 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.907877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:26.940063 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:26.940031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:27.009285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009398    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009439    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009465    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl7mr\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009677    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009703    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.009865 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.009853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.010109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.010001    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.010344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.010321    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.011748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.011731    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.012162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.012143    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.019881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.019860    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.020346 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.020330    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl7mr\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr\") pod \"e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") " pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.068431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.068403    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:27.260333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.260249    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:27.353545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.353516    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:33:27.354365 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:33:27.354339    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6827455_e067_4715_b857_d1f28e6d28fa.slice/crio-078788b67473e5f94b05d5276070853a5bc92c78757287f3aea8dc7fd36bbdd9 WatchSource:0}: Error finding container 078788b67473e5f94b05d5276070853a5bc92c78757287f3aea8dc7fd36bbdd9: Status 404 returned error can't find the container with id 078788b67473e5f94b05d5276070853a5bc92c78757287f3aea8dc7fd36bbdd9
Sep 19 01:33:27.356641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.356612    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:27.356717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.356673    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:27.356717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.356703    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:27.435709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.435661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerStarted","Data":"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"}
Sep 19 01:33:27.435709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.435714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerStarted","Data":"078788b67473e5f94b05d5276070853a5bc92c78757287f3aea8dc7fd36bbdd9"}
Sep 19 01:33:27.461027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.460965    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podStartSLOduration=1.460945712 podStartE2EDuration="1.460945712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:33:27.456296276 +0000 UTC m=+1254.797744200" watchObservedRunningTime="2026-09-19 01:33:27.460945712 +0000 UTC m=+1254.802393639"
Sep 19 01:33:27.915412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:27.915380    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:28.069056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:28.069025    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:28.070159 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:28.070137    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:33:28.070290 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:28.070181    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:33:29.072891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.072861    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:29.196371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.196333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:29.446445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.446352    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:29.447426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.447401    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:29.697428 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.697337    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:29.796517 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:29.796488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:30.365747 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:30.365710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:31.676149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:31.676111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:32.570488 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:32.570446    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:32.683009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:32.682969    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:33.149535 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:33.149500    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:33.253258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:33.253226    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:33.345724 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:33.345690    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:33.838985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:33.838946    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:34.722295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:34.722263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:35.628126 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:35.628084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:36.435832 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:36.435800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:56.615462 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.615430    2567 generic.go:356] "Generic (PLEG): container finished" podID="d6827455-e067-4715-b857-d1f28e6d28fa" containerID="19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d" exitCode=0
Sep 19 01:33:56.615866 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.615502    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerDied","Data":"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"}
Sep 19 01:33:56.615952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.615936    2567 scope.go:117] "RemoveContainer" containerID="19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"
Sep 19 01:33:56.617080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.617050    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:56.617129 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.617120    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:56.617167 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:56.617149    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:33:57.626399 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:57.626365    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerStarted","Data":"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"}
Sep 19 01:33:58.069454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:58.069424    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:58.070482 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:58.070459    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:33:58.070607 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:58.070507    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:33:58.760297 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:58.760264    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:33:59.068777 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:59.068738    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:33:59.069006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:59.068810    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:33:59.446964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:59.446861    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:33:59.850687 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:33:59.850642    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:00.069538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:00.069505    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:34:00.069713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:00.069579    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:34:00.106841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:00.106738    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:01.061193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:01.061150    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:01.069274 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:01.069246    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:34:01.069435 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:01.069315    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:34:02.052988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:02.052954    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:02.069199 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:02.069167    2567 patch_prober.go:28] interesting pod/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 19 01:34:02.069686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:02.069228    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 19 01:34:02.943661 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:02.943623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:03.073988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:03.073961    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:34:03.074826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:03.074805    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:34:03.784890 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:03.784859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:04.702455 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:04.702422    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:05.564750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:05.564718    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:06.224231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:06.224198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:07.046050 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:07.046012    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:11.321167 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:11.321125    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:15.319034 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:15.318996    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:16.963735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:16.963705    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:17.002709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.002679    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:34:17.002950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.002896    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerName="payload-processing" containerID="cri-o://9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8" gracePeriod=30
Sep 19 01:34:17.119348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.119313    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:17.167375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.167340    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.62:9004: connect: connection refused"
Sep 19 01:34:17.269130 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.267142    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:17.280951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.280858    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:34:17.388372 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.388332    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:17.414524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.414499    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkm8s\" (UniqueName: \"kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s\") pod \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") "
Sep 19 01:34:17.414656 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.414590    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume\") pod \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\" (UID: \"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a\") "
Sep 19 01:34:17.414950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.414904    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" (UID: "8944cbad-e2d2-4c2a-ac4d-d3c0384b918a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:34:17.416567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.416533    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s" (OuterVolumeSpecName: "kube-api-access-rkm8s") pod "8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" (UID: "8944cbad-e2d2-4c2a-ac4d-d3c0384b918a"). InnerVolumeSpecName "kube-api-access-rkm8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:34:17.482024 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.481991    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:17.515845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.515767    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkm8s\" (UniqueName: \"kubernetes.io/projected/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-kube-api-access-rkm8s\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:34:17.515845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.515792    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:34:17.734745 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.734708    2567 generic.go:356] "Generic (PLEG): container finished" podID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerID="9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8" exitCode=0
Sep 19 01:34:17.734945 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.734748    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"
Sep 19 01:34:17.734945 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.734792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" event={"ID":"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a","Type":"ContainerDied","Data":"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"}
Sep 19 01:34:17.734945 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.734840    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj" event={"ID":"8944cbad-e2d2-4c2a-ac4d-d3c0384b918a","Type":"ContainerDied","Data":"d2d2e57ebae5d2d80d54c7305978734cfc96e6d8f49aa75d8254684ed790917b"}
Sep 19 01:34:17.734945 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.734864    2567 scope.go:117] "RemoveContainer" containerID="9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"
Sep 19 01:34:17.748181 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.748162    2567 scope.go:117] "RemoveContainer" containerID="9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"
Sep 19 01:34:17.748486 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:34:17.748468    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8\": container with ID starting with 9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8 not found: ID does not exist" containerID="9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"
Sep 19 01:34:17.748545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.748495    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8"} err="failed to get container status \"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8\": rpc error: code = NotFound desc = could not find container \"9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8\": container with ID starting with 9e3e17e304b00005c93a095b752f2fc7073475c34ea768b9ca5ee3f8999865f8 not found: ID does not exist"
Sep 19 01:34:17.774682 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.774626    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:34:17.780680 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.780657    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-b5fe4519-b98fcfd77-9csxj"]
Sep 19 01:34:17.960000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:17.959960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:18.921055 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:18.921017    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" path="/var/lib/kubelet/pods/8944cbad-e2d2-4c2a-ac4d-d3c0384b918a/volumes"
Sep 19 01:34:19.146214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:19.146173    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:20.392137 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:20.392096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:21.021095 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:21.021063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:21.433654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:21.433623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:21.649444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:21.649386    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:22.498808 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:22.498771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:23.304313 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:23.304272    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:26.096663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:26.096625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:32.181426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:32.181386    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:32.242345 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:32.242314    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:34:54.818313 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:34:54.818278    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:03.058872 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:03.058827    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:03.483076 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:03.482976    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:09.309060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:09.309029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:13.031853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:13.031815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:33.862156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:33.862111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:33.962639 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:33.962609    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:34.165432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:34.165359    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:35.619953 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:35.619900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:35.715870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:35.715839    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:35.815673 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:35.815639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:36.669166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:36.669136    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:36.749908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:36.749871    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:38.247180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:38.247149    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:40.840712 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:40.840675    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:44.877165 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:44.877130    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:44.958325 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:44.958288    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:45.622428 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:45.622391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:51.619154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:51.619116    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:51.728621 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:51.728576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:35:51.821787 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:35:51.821758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:02.375754 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:02.375712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:02.587149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:02.587112    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:11.878410 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:11.878375    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:12.819117 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:12.819077    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:13.525717 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:13.525678    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:14.401275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:14.401238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:15.244950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:15.244899    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:16.113255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:16.113216    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:16.829215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:16.829135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:17.053669 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:17.053632    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:36:17.228998 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:17.228902    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:23.631412 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:23.631379    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:27.776413 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:27.776355    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:27.857952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:27.857880    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:27.954606 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:27.954561    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:28.032782 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:28.032753    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:28.426431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:28.426338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:28.527983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:28.527953    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:29.277070 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:29.277021    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:30.188376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:30.188341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:30.833728 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:30.833685    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:30.941375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:30.941340    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:31.133217 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:31.133121    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:31.437879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:31.437789    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:31.660750 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:31.660716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:32.062567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.062526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:32.073309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.073274    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" podUID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" containerName="main" containerID="cri-o://dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6" gracePeriod=45
Sep 19 01:36:32.206418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.206387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:32.323460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.323402    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:36:32.408098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408068    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4txj\" (UniqueName: \"kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408109    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408133    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408221    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408269    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache\") pod \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\" (UID: \"dac683cd-2285-45e9-a2b6-ee8897dcb8b7\") "
Sep 19 01:36:32.408538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408394    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:32.408662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408614    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home" (OuterVolumeSpecName: "home") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:32.408662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408645    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache" (OuterVolumeSpecName: "model-cache") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:32.408973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408954    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tmp-dir\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.408973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408972    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-home\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.409133 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.408984    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-model-cache\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.410870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.410835    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj" (OuterVolumeSpecName: "kube-api-access-d4txj") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "kube-api-access-d4txj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:36:32.410870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.410859    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm" (OuterVolumeSpecName: "dshm") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:32.411112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.411088    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dac683cd-2285-45e9-a2b6-ee8897dcb8b7" (UID: "dac683cd-2285-45e9-a2b6-ee8897dcb8b7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:36:32.446488 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.446459    2567 generic.go:356] "Generic (PLEG): container finished" podID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" containerID="dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6" exitCode=0
Sep 19 01:36:32.446616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.446497    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" event={"ID":"dac683cd-2285-45e9-a2b6-ee8897dcb8b7","Type":"ContainerDied","Data":"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"}
Sep 19 01:36:32.446616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.446497    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"
Sep 19 01:36:32.446616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.446531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk" event={"ID":"dac683cd-2285-45e9-a2b6-ee8897dcb8b7","Type":"ContainerDied","Data":"3579bb8a4f16d550a77121bb8422df0a1007ba34217cd8754132f53d93171309"}
Sep 19 01:36:32.446616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.446554    2567 scope.go:117] "RemoveContainer" containerID="dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"
Sep 19 01:36:32.457542 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.457517    2567 scope.go:117] "RemoveContainer" containerID="dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"
Sep 19 01:36:32.457853 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:36:32.457825    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6\": container with ID starting with dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6 not found: ID does not exist" containerID="dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"
Sep 19 01:36:32.457970 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.457866    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6"} err="failed to get container status \"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6\": rpc error: code = NotFound desc = could not find container \"dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6\": container with ID starting with dc5d4e2030a28ab7fec74f42b5f28fbd5d4dc1dbc66c96b1250951a2bc29cbd6 not found: ID does not exist"
Sep 19 01:36:32.492651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.492624    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:36:32.500197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.500173    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-8e708f/premium-w0-8e708f-kserve-647fd79d6b-kgjxk"]
Sep 19 01:36:32.510024 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.510005    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-dshm\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.510024 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.510026    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4txj\" (UniqueName: \"kubernetes.io/projected/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-kube-api-access-d4txj\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.510166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.510036    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dac683cd-2285-45e9-a2b6-ee8897dcb8b7-tls-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:32.921766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:32.921728    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" path="/var/lib/kubelet/pods/dac683cd-2285-45e9-a2b6-ee8897dcb8b7/volumes"
Sep 19 01:36:34.096060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:34.096027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:34.937651 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:34.937619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:35.028077 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.028046    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:35.147911 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.147880    2567 scope.go:117] "RemoveContainer" containerID="34bfc70ea0f2c9156be0442b31591310f10c6e8ded8aaed192ed1962f13f8dc7"
Sep 19 01:36:35.543135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.543101    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:35.638555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.638522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:35.808543 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.808465    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:36:35.808736 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.808712    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy" containerID="cri-o://213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026" gracePeriod=30
Sep 19 01:36:35.849450 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:35.849420    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:36.032222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:36.032187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:36.936415 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:36.936383    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:37.655475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:37.655426    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:38.431610 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:38.431570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:38.539138 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:38.534265    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:38.632814 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:38.632771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:38.953577 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:38.953539    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:39.068288 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:39.068253    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:41.062586 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.062564    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:36:41.210008 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.209911    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210008 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.209978    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrzxd\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210008 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210005    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210038    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210184    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210296 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210268    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210307    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210348    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210387    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:36:41.210461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210380    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:41.210461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data\") pod \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\" (UID: \"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d\") "
Sep 19 01:36:41.210734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210551    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:41.210734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210630    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:41.210734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210723    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:41.210983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210959    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.210983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210983    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.211184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.210996    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.211184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.211008    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.211184 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.211021    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.212203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.212180    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd" (OuterVolumeSpecName: "kube-api-access-jrzxd") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "kube-api-access-jrzxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:36:41.212322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.212306    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:36:41.212392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.212379    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:36:41.212433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.212414    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" (UID: "711dc6d1-46f4-4923-8a8d-70d33d6f1a6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:36:41.311770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.311742    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.311770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.311766    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.311770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.311775    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrzxd\" (UniqueName: \"kubernetes.io/projected/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-kube-api-access-jrzxd\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.311991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.311785    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:36:41.496214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.496130    2567 generic.go:356] "Generic (PLEG): container finished" podID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerID="213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026" exitCode=0
Sep 19 01:36:41.496214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.496193    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"
Sep 19 01:36:41.496387 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.496204    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerDied","Data":"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"}
Sep 19 01:36:41.496387 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.496260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64" event={"ID":"711dc6d1-46f4-4923-8a8d-70d33d6f1a6d","Type":"ContainerDied","Data":"419bf2f41dce323ab3e2090086a134d2cf649d556a67da10eec34dc6a8373ca7"}
Sep 19 01:36:41.496387 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.496285    2567 scope.go:117] "RemoveContainer" containerID="213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"
Sep 19 01:36:41.505775 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.505761    2567 scope.go:117] "RemoveContainer" containerID="58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"
Sep 19 01:36:41.513854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.513835    2567 scope.go:117] "RemoveContainer" containerID="213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"
Sep 19 01:36:41.514125 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:36:41.514103    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026\": container with ID starting with 213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026 not found: ID does not exist" containerID="213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"
Sep 19 01:36:41.514217 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.514131    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026"} err="failed to get container status \"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026\": rpc error: code = NotFound desc = could not find container \"213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026\": container with ID starting with 213cfc88877ef4c4047808817ad6ef28c4db7d2c160fa5823a37f6fc0adfb026 not found: ID does not exist"
Sep 19 01:36:41.514217 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.514148    2567 scope.go:117] "RemoveContainer" containerID="58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"
Sep 19 01:36:41.514431 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:36:41.514411    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea\": container with ID starting with 58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea not found: ID does not exist" containerID="58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"
Sep 19 01:36:41.514475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.514439    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea"} err="failed to get container status \"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea\": rpc error: code = NotFound desc = could not find container \"58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea\": container with ID starting with 58f544b09e4577430ace6b32f885188221fa266ee420ad4315b0eb08d5bb5cea not found: ID does not exist"
Sep 19 01:36:41.520759 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.520738    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:36:41.525326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.525306    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-8e708f-openshift-default-c57f9d54d-nmq64"]
Sep 19 01:36:41.741630 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:41.741596    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:42.920905 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:42.920870    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" path="/var/lib/kubelet/pods/711dc6d1-46f4-4923-8a8d-70d33d6f1a6d/volumes"
Sep 19 01:36:47.420604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:47.420572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:54.758576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:54.758530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:54.860897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:54.860856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:36:55.003746 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:36:55.003710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:00.330716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:00.330675    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:01.206705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:01.206659    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:01.606818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:01.606776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:02.540573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:02.540533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:03.244433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:03.244393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:03.921384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:03.921354    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:04.716515 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:04.716475    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:05.046175 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:05.046147    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:05.452732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:05.452637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:05.568608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:05.568569    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:05.889780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:05.889746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:06.360362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:06.360329    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:09.313623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:09.313584    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:09.515131 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:09.515098    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:09.704780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:09.704687    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:10.928578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:10.928540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:11.618331 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:11.618291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:12.318337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:12.318302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:13.064445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:13.064411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:13.850341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:13.850307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:13.943950 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:13.943897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:14.610813 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.610771    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:14.708618 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.708575    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:14.714942 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.714904    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:37:14.715386 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715369    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" containerName="main"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715387    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" containerName="main"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715433    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715444    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715457    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715466    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715476    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerName="payload-processing"
Sep 19 01:37:14.715483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715484    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerName="payload-processing"
Sep 19 01:37:14.715824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715570    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dac683cd-2285-45e9-a2b6-ee8897dcb8b7" containerName="main"
Sep 19 01:37:14.715824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715584    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.715824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.715596    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8944cbad-e2d2-4c2a-ac4d-d3c0384b918a" containerName="payload-processing"
Sep 19 01:37:14.718720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.718702    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.721556 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.721537    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-29d76c\""
Sep 19 01:37:14.721654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.721577    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-29d76c-dockercfg-74tpp\""
Sep 19 01:37:14.728418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.728298    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:37:14.746703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.746676    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:37:14.747325 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.747304    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="711dc6d1-46f4-4923-8a8d-70d33d6f1a6d" containerName="istio-proxy"
Sep 19 01:37:14.750481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.750465    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.762051 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.762029    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:37:14.865947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.865807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h998c\" (UniqueName: \"kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.865947 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.865895    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgnhc\" (UniqueName: \"kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.866514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.865955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.866514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.866001    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.966992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.966960    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h998c\" (UniqueName: \"kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.967164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.967006    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgnhc\" (UniqueName: \"kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.967164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.967040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.967164 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.967076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.967739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.967715    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.967832 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.967763    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:14.975715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.975686    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgnhc\" (UniqueName: \"kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc\") pod \"payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") " pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:14.976162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:14.976141    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h998c\" (UniqueName: \"kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c\") pod \"payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:15.030600 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.030575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:15.059707 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.059680    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:15.313098 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.313059    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:37:15.317740 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:37:15.317716    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf09bc5b_6819_47a2_9ad8_c730c461e239.slice/crio-972c64785bc17e92d95291e63ea8a92ebb9d8deb46d13e19e28cfb1ec1283bbd WatchSource:0}: Error finding container 972c64785bc17e92d95291e63ea8a92ebb9d8deb46d13e19e28cfb1ec1283bbd: Status 404 returned error can't find the container with id 972c64785bc17e92d95291e63ea8a92ebb9d8deb46d13e19e28cfb1ec1283bbd
Sep 19 01:37:15.346279 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.346257    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:37:15.349035 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:37:15.349009    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29b7e38_3ca3_4f4a_b676_b419bb7d3b63.slice/crio-dde9867361f95c3e0188fdef5d3e4c9b0caa17635c54ab02317f85b0588d8ea5 WatchSource:0}: Error finding container dde9867361f95c3e0188fdef5d3e4c9b0caa17635c54ab02317f85b0588d8ea5: Status 404 returned error can't find the container with id dde9867361f95c3e0188fdef5d3e4c9b0caa17635c54ab02317f85b0588d8ea5
Sep 19 01:37:15.668837 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.668753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" event={"ID":"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63","Type":"ContainerStarted","Data":"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"}
Sep 19 01:37:15.668837 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.668803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" event={"ID":"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63","Type":"ContainerStarted","Data":"dde9867361f95c3e0188fdef5d3e4c9b0caa17635c54ab02317f85b0588d8ea5"}
Sep 19 01:37:15.669368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.668935    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:15.670467 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.670438    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" event={"ID":"cf09bc5b-6819-47a2-9ad8-c730c461e239","Type":"ContainerStarted","Data":"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"}
Sep 19 01:37:15.670583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.670480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" event={"ID":"cf09bc5b-6819-47a2-9ad8-c730c461e239","Type":"ContainerStarted","Data":"972c64785bc17e92d95291e63ea8a92ebb9d8deb46d13e19e28cfb1ec1283bbd"}
Sep 19 01:37:15.670583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.670499    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:15.692153 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.692106    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" podStartSLOduration=1.692088697 podStartE2EDuration="1.692088697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:37:15.688008938 +0000 UTC m=+1483.029456862" watchObservedRunningTime="2026-09-19 01:37:15.692088697 +0000 UTC m=+1483.033536620"
Sep 19 01:37:15.708787 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:15.708729    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" podStartSLOduration=1.708712105 podStartE2EDuration="1.708712105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:37:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:37:15.708122751 +0000 UTC m=+1483.049570678" watchObservedRunningTime="2026-09-19 01:37:15.708712105 +0000 UTC m=+1483.050160029"
Sep 19 01:37:20.116379 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:20.116345    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:26.677711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:26.677678    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:37:26.678262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:26.677865    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:37:34.979780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:34.979750    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:37:34.988365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:34.988345    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:37:36.796793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:36.796755    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:38.282496 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:38.282463    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:38.974080 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:38.974041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:39.226954 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:39.226852    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:39.815734 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:39.815672    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:40.808908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:40.808876    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:41.999085 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:41.999041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:42.243776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:42.243740    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:43.109417 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:43.109381    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:44.017527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:44.017493    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:44.825057 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:44.825025    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:45.509112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:45.509074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:46.315309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:46.315275    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:47.142642 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:47.142607    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:47.850924 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:47.850893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:51.376083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:51.376045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:52.459709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:52.459675    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:52.910156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:52.910119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:53.913796 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:53.913764    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:58.243194 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:58.243155    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:58.401676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:58.401646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:58.623477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:58.623360    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:58.710119 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:58.710079    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:59.037087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:59.037050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:59.136757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:59.136721    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:59.239818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:59.239782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:37:59.962720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:37:59.962683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:00.680550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:00.680511    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:01.323966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:01.323909    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:01.534627 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:01.534591    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:02.370124 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:02.370087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:03.224398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:03.224361    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:05.211985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:05.211947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:05.317827 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:05.317770    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:05.487368 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:05.487287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:06.037432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:06.037395    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:06.913973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:06.913934    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:07.748104 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:07.748071    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:08.730312 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:08.730281    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:09.620365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:09.620335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:10.345778 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:10.345743    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:11.046618 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:11.046583    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:21.603124 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.603086    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:21.633580 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.633549    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:38:21.633821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.633795    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" podUID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" containerName="payload-processing" containerID="cri-o://d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9" gracePeriod=30
Sep 19 01:38:21.647785 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.647757    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:38:21.648051 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.648008    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" podUID="cf09bc5b-6819-47a2-9ad8-c730c461e239" containerName="payload-pre-processing" containerID="cri-o://ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41" gracePeriod=30
Sep 19 01:38:21.685541 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.685508    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:21.761591 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.761559    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:21.850341 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.850305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:21.907902 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.907365    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:38:21.945463 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:21.945441    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:38:22.008960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.008896    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgnhc\" (UniqueName: \"kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc\") pod \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") "
Sep 19 01:38:22.009137 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.009076    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume\") pod \"cf09bc5b-6819-47a2-9ad8-c730c461e239\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") "
Sep 19 01:38:22.009137 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.009127    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume\") pod \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\" (UID: \"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63\") "
Sep 19 01:38:22.009260 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.009164    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h998c\" (UniqueName: \"kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c\") pod \"cf09bc5b-6819-47a2-9ad8-c730c461e239\" (UID: \"cf09bc5b-6819-47a2-9ad8-c730c461e239\") "
Sep 19 01:38:22.009482 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.009455    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf09bc5b-6819-47a2-9ad8-c730c461e239" (UID: "cf09bc5b-6819-47a2-9ad8-c730c461e239"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:22.009578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.009534    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" (UID: "b29b7e38-3ca3-4f4a-b676-b419bb7d3b63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:22.011276 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011245    2567 generic.go:356] "Generic (PLEG): container finished" podID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" containerID="d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9" exitCode=0
Sep 19 01:38:22.011401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011282    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"
Sep 19 01:38:22.011401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011297    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc" (OuterVolumeSpecName: "kube-api-access-hgnhc") pod "b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" (UID: "b29b7e38-3ca3-4f4a-b676-b419bb7d3b63"). InnerVolumeSpecName "kube-api-access-hgnhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:22.011401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011331    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" event={"ID":"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63","Type":"ContainerDied","Data":"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"}
Sep 19 01:38:22.011401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r" event={"ID":"b29b7e38-3ca3-4f4a-b676-b419bb7d3b63","Type":"ContainerDied","Data":"dde9867361f95c3e0188fdef5d3e4c9b0caa17635c54ab02317f85b0588d8ea5"}
Sep 19 01:38:22.011616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011420    2567 scope.go:117] "RemoveContainer" containerID="d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"
Sep 19 01:38:22.011616 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.011604    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c" (OuterVolumeSpecName: "kube-api-access-h998c") pod "cf09bc5b-6819-47a2-9ad8-c730c461e239" (UID: "cf09bc5b-6819-47a2-9ad8-c730c461e239"). InnerVolumeSpecName "kube-api-access-h998c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:22.012804 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.012781    2567 generic.go:356] "Generic (PLEG): container finished" podID="cf09bc5b-6819-47a2-9ad8-c730c461e239" containerID="ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41" exitCode=0
Sep 19 01:38:22.012906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.012824    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" event={"ID":"cf09bc5b-6819-47a2-9ad8-c730c461e239","Type":"ContainerDied","Data":"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"}
Sep 19 01:38:22.012906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.012882    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw" event={"ID":"cf09bc5b-6819-47a2-9ad8-c730c461e239","Type":"ContainerDied","Data":"972c64785bc17e92d95291e63ea8a92ebb9d8deb46d13e19e28cfb1ec1283bbd"}
Sep 19 01:38:22.012906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.012830    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"
Sep 19 01:38:22.020592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.020451    2567 scope.go:117] "RemoveContainer" containerID="d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"
Sep 19 01:38:22.020824 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:22.020805    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9\": container with ID starting with d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9 not found: ID does not exist" containerID="d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"
Sep 19 01:38:22.020891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.020832    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9"} err="failed to get container status \"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9\": rpc error: code = NotFound desc = could not find container \"d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9\": container with ID starting with d2330902b43f7cc3bc3245cac68b88f9aaea9005b2713a9bf010a3a0acd655a9 not found: ID does not exist"
Sep 19 01:38:22.020891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.020848    2567 scope.go:117] "RemoveContainer" containerID="ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"
Sep 19 01:38:22.028898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.028883    2567 scope.go:117] "RemoveContainer" containerID="ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"
Sep 19 01:38:22.029149 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:22.029131    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41\": container with ID starting with ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41 not found: ID does not exist" containerID="ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"
Sep 19 01:38:22.029197 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.029155    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41"} err="failed to get container status \"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41\": rpc error: code = NotFound desc = could not find container \"ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41\": container with ID starting with ef81cd5bc9b6515e69f71ad67c7111876ac6b9cba64d9b20bb626fdfd73eaa41 not found: ID does not exist"
Sep 19 01:38:22.039228 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.039204    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:38:22.043469 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.043448    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29d76c-76957b86fd-7sdgw"]
Sep 19 01:38:22.056904 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.056880    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:38:22.061828 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.061807    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-29d76c-76d8fdbb7-xbs8r"]
Sep 19 01:38:22.110550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.110527    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgnhc\" (UniqueName: \"kubernetes.io/projected/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-kube-api-access-hgnhc\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:22.110611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.110551    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf09bc5b-6819-47a2-9ad8-c730c461e239-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:22.110611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.110565    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:22.110611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.110575    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h998c\" (UniqueName: \"kubernetes.io/projected/cf09bc5b-6819-47a2-9ad8-c730c461e239-kube-api-access-h998c\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:22.214198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.214125    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:22.329181 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.329143    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:22.920878 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.920804    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" path="/var/lib/kubelet/pods/b29b7e38-3ca3-4f4a-b676-b419bb7d3b63/volumes"
Sep 19 01:38:22.921223 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:22.921194    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf09bc5b-6819-47a2-9ad8-c730c461e239" path="/var/lib/kubelet/pods/cf09bc5b-6819-47a2-9ad8-c730c461e239/volumes"
Sep 19 01:38:23.037442 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:23.037411    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:23.920585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:23.920555    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:24.630774 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:24.630737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:25.294424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:25.294387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:25.962489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:25.962447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:28.021550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:28.021508    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:28.128472 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:28.128423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:28.329457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:28.329415    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:29.042749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:29.042696    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:30.218050 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:30.218013    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:30.948581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:30.948541    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:31.060625 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:31.060582    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:31.815178 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:31.815140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:32.536845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:32.536812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:33.271438 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:33.271400    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:39.398187 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.398151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:39.435824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.435795    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:38:39.436090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.436055    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" podUID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" containerName="payload-processing" containerID="cri-o://f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2" gracePeriod=30
Sep 19 01:38:39.499569 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.499536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:39.598300 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.598256    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:39.664156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.664122    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:39.679398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.679377    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:38:39.774042 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.774013    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hbfn\" (UniqueName: \"kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn\") pod \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") "
Sep 19 01:38:39.774215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.774135    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume\") pod \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\" (UID: \"b7fb3793-b499-4e98-9ca0-52e463dbbcf9\") "
Sep 19 01:38:39.774513 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.774491    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b7fb3793-b499-4e98-9ca0-52e463dbbcf9" (UID: "b7fb3793-b499-4e98-9ca0-52e463dbbcf9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:39.776087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.776064    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn" (OuterVolumeSpecName: "kube-api-access-4hbfn") pod "b7fb3793-b499-4e98-9ca0-52e463dbbcf9" (UID: "b7fb3793-b499-4e98-9ca0-52e463dbbcf9"). InnerVolumeSpecName "kube-api-access-4hbfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:39.875221 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.875181    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hbfn\" (UniqueName: \"kubernetes.io/projected/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-kube-api-access-4hbfn\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:39.875221 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:39.875217    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b7fb3793-b499-4e98-9ca0-52e463dbbcf9-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:40.097253 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.097224    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:40.109336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.109304    2567 generic.go:356] "Generic (PLEG): container finished" podID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" containerID="f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2" exitCode=0
Sep 19 01:38:40.109461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.109342    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"
Sep 19 01:38:40.109461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.109345    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" event={"ID":"b7fb3793-b499-4e98-9ca0-52e463dbbcf9","Type":"ContainerDied","Data":"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"}
Sep 19 01:38:40.109461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.109396    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv" event={"ID":"b7fb3793-b499-4e98-9ca0-52e463dbbcf9","Type":"ContainerDied","Data":"c3771f8f61a23c43647f7e49852a6b74f430fc0a5f932583757ed42ab0c35f56"}
Sep 19 01:38:40.109461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.109421    2567 scope.go:117] "RemoveContainer" containerID="f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"
Sep 19 01:38:40.119040 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.119023    2567 scope.go:117] "RemoveContainer" containerID="f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"
Sep 19 01:38:40.119317 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:40.119299    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2\": container with ID starting with f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2 not found: ID does not exist" containerID="f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"
Sep 19 01:38:40.119370 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.119325    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2"} err="failed to get container status \"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2\": rpc error: code = NotFound desc = could not find container \"f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2\": container with ID starting with f20a44c5cd7f2abb7e73bba013b112ce4df41357ff6841aed4ef1aec957daca2 not found: ID does not exist"
Sep 19 01:38:40.138725 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.138700    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:38:40.143482 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.143462    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-10325b-77b9b4db7-xrhgv"]
Sep 19 01:38:40.185392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.185356    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:40.856144 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.856106    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:40.921418 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:40.921378    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" path="/var/lib/kubelet/pods/b7fb3793-b499-4e98-9ca0-52e463dbbcf9/volumes"
Sep 19 01:38:41.738709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:41.738674    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:42.631660 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:42.631626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:43.941751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:43.941716    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:44.010447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:44.010418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:46.644127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:46.644089    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:46.751960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:46.751907    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:46.901931 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:46.901835    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:38:46.902099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:46.902074    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" containerID="cri-o://4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2" gracePeriod=30
Sep 19 01:38:46.926564 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:46.926535    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:47.677416 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:47.677382    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:48.726563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:48.726530    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:49.452898 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:49.452862    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:50.303979 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:50.303939    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:50.998344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:50.998314    2567 patch_prober.go:28] interesting pod/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 01:38:50.998507 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:50.998366    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 01:38:51.289516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:51.289471    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:52.155719 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.155696    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:38:52.180864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.180794    2567 generic.go:356] "Generic (PLEG): container finished" podID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerID="4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2" exitCode=0
Sep 19 01:38:52.180864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.180846    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"
Sep 19 01:38:52.180864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.180852    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerDied","Data":"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"}
Sep 19 01:38:52.181140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.180903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k" event={"ID":"3fa97960-18d9-4b81-bd14-aa80c2b0097a","Type":"ContainerDied","Data":"97e39547397c46485c14712472c02d4cad7137526734f9505440b1c12114dd17"}
Sep 19 01:38:52.181140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.180955    2567 scope.go:117] "RemoveContainer" containerID="4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"
Sep 19 01:38:52.186810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.186787    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.186966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.186852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.186966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.186891    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.186966 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.186950    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jscmj\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.187156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.186990    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.187156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187017    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.187156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187044    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.187156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187071    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.187156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187095    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token\") pod \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\" (UID: \"3fa97960-18d9-4b81-bd14-aa80c2b0097a\") "
Sep 19 01:38:52.188028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187090    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:38:52.188028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187168    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:38:52.188028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187725    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:52.188028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.187972    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data" (OuterVolumeSpecName: "istio-data") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:38:52.188028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.188007    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:38:52.189776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.189738    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:38:52.189776 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.189750    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj" (OuterVolumeSpecName: "kube-api-access-jscmj") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "kube-api-access-jscmj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:52.190038 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.190012    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:38:52.190269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.190237    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token" (OuterVolumeSpecName: "istio-token") pod "3fa97960-18d9-4b81-bd14-aa80c2b0097a" (UID: "3fa97960-18d9-4b81-bd14-aa80c2b0097a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:52.192221 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.192198    2567 scope.go:117] "RemoveContainer" containerID="5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"
Sep 19 01:38:52.208723 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.208668    2567 scope.go:117] "RemoveContainer" containerID="4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"
Sep 19 01:38:52.208972 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:52.208949    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2\": container with ID starting with 4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2 not found: ID does not exist" containerID="4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"
Sep 19 01:38:52.209058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.208979    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2"} err="failed to get container status \"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2\": rpc error: code = NotFound desc = could not find container \"4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2\": container with ID starting with 4783853a126f5aeee5bd251f1eb046dcbd0ac1dc3c784cbc9641f984748786a2 not found: ID does not exist"
Sep 19 01:38:52.209058 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.208997    2567 scope.go:117] "RemoveContainer" containerID="5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"
Sep 19 01:38:52.209247 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:52.209230    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7\": container with ID starting with 5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7 not found: ID does not exist" containerID="5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"
Sep 19 01:38:52.209322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.209250    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7"} err="failed to get container status \"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7\": rpc error: code = NotFound desc = could not find container \"5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7\": container with ID starting with 5ebbbbfc72af34e26781a190cf6ad618edddaad728e55c0b95fda71ed1a6a4f7 not found: ID does not exist"
Sep 19 01:38:52.289099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289077    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289098    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jscmj\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-kube-api-access-jscmj\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289110    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289119    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289127    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289138    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289150    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fa97960-18d9-4b81-bd14-aa80c2b0097a-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289157    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.289227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.289165    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fa97960-18d9-4b81-bd14-aa80c2b0097a-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:52.514546 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.514522    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:38:52.526048 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.526023    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-10325b-openshift-default-674ffb986d-dvc6k"]
Sep 19 01:38:52.921564 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:52.921532    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" path="/var/lib/kubelet/pods/3fa97960-18d9-4b81-bd14-aa80c2b0097a/volumes"
Sep 19 01:38:56.777626 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:56.777569    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.023576 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.023535    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.574636 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.574601    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:38:58.574891 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.574846    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" podUID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" containerName="maas-api" containerID="cri-o://873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5" gracePeriod=30
Sep 19 01:38:58.612784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.612757    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.636849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.636823    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:38:58.637079 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.637056    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" podUID="88f69691-7093-4e3b-ac64-5a19346fc709" containerName="payload-processing" containerID="cri-o://cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1" gracePeriod=30
Sep 19 01:38:58.642500 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.642479    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:38:58.642700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.642676    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerName="payload-pre-processing" containerID="cri-o://a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6" gracePeriod=30
Sep 19 01:38:58.684138 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.684108    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.757231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.757201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.837068 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.836991    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.935711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.935665    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:58.937883 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.937853    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:38:58.940317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.940297    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:38:58.949756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:58.949738    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:38:59.043230 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043187    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z54wf\" (UniqueName: \"kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf\") pod \"88f69691-7093-4e3b-ac64-5a19346fc709\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043260    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs\") pod \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043287    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca\") pod \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043351    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume\") pod \"88f69691-7093-4e3b-ac64-5a19346fc709\" (UID: \"88f69691-7093-4e3b-ac64-5a19346fc709\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043388    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4r9q\" (UniqueName: \"kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q\") pod \"2c99a99c-0d54-464b-9887-d3936dd200b6\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043439    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume\") pod \"2c99a99c-0d54-464b-9887-d3936dd200b6\" (UID: \"2c99a99c-0d54-464b-9887-d3936dd200b6\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043479    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls\") pod \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") "
Sep 19 01:38:59.043697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043555    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7j66\" (UniqueName: \"kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66\") pod \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\" (UID: \"fb357433-fad5-4d1c-841e-42d8b0b3f4f6\") "
Sep 19 01:38:59.044162 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.044078    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88f69691-7093-4e3b-ac64-5a19346fc709" (UID: "88f69691-7093-4e3b-ac64-5a19346fc709"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:59.044819 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.043910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2c99a99c-0d54-464b-9887-d3936dd200b6" (UID: "2c99a99c-0d54-464b-9887-d3936dd200b6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:59.045060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.044976    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb357433-fad5-4d1c-841e-42d8b0b3f4f6" (UID: "fb357433-fad5-4d1c-841e-42d8b0b3f4f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:38:59.046143 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.046114    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf" (OuterVolumeSpecName: "kube-api-access-z54wf") pod "88f69691-7093-4e3b-ac64-5a19346fc709" (UID: "88f69691-7093-4e3b-ac64-5a19346fc709"). InnerVolumeSpecName "kube-api-access-z54wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:59.046262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.046162    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fb357433-fad5-4d1c-841e-42d8b0b3f4f6" (UID: "fb357433-fad5-4d1c-841e-42d8b0b3f4f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:38:59.046572 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.046547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66" (OuterVolumeSpecName: "kube-api-access-n7j66") pod "fb357433-fad5-4d1c-841e-42d8b0b3f4f6" (UID: "fb357433-fad5-4d1c-841e-42d8b0b3f4f6"). InnerVolumeSpecName "kube-api-access-n7j66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:59.046957 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.046910    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb357433-fad5-4d1c-841e-42d8b0b3f4f6" (UID: "fb357433-fad5-4d1c-841e-42d8b0b3f4f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:38:59.047166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.047150    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q" (OuterVolumeSpecName: "kube-api-access-j4r9q") pod "2c99a99c-0d54-464b-9887-d3936dd200b6" (UID: "2c99a99c-0d54-464b-9887-d3936dd200b6"). InnerVolumeSpecName "kube-api-access-j4r9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144724    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144750    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7j66\" (UniqueName: \"kubernetes.io/projected/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-kube-api-access-n7j66\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144759    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z54wf\" (UniqueName: \"kubernetes.io/projected/88f69691-7093-4e3b-ac64-5a19346fc709-kube-api-access-z54wf\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144770    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144778    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb357433-fad5-4d1c-841e-42d8b0b3f4f6-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144786    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88f69691-7093-4e3b-ac64-5a19346fc709-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144795    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4r9q\" (UniqueName: \"kubernetes.io/projected/2c99a99c-0d54-464b-9887-d3936dd200b6-kube-api-access-j4r9q\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.144803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.144805    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2c99a99c-0d54-464b-9887-d3936dd200b6-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:38:59.201604 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.201570    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:59.217322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.217296    2567 generic.go:356] "Generic (PLEG): container finished" podID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" containerID="873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5" exitCode=0
Sep 19 01:38:59.217447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.217341    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"
Sep 19 01:38:59.217447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.217383    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" event={"ID":"fb357433-fad5-4d1c-841e-42d8b0b3f4f6","Type":"ContainerDied","Data":"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"}
Sep 19 01:38:59.217447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.217434    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc" event={"ID":"fb357433-fad5-4d1c-841e-42d8b0b3f4f6","Type":"ContainerDied","Data":"88b0ecd2a480cc0a7f05d15db3b732a02e7a4c4d00f82801d1fd178553477690"}
Sep 19 01:38:59.217578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.217462    2567 scope.go:117] "RemoveContainer" containerID="873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"
Sep 19 01:38:59.218784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.218768    2567 generic.go:356] "Generic (PLEG): container finished" podID="88f69691-7093-4e3b-ac64-5a19346fc709" containerID="cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1" exitCode=0
Sep 19 01:38:59.218876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.218825    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"
Sep 19 01:38:59.218876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.218843    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" event={"ID":"88f69691-7093-4e3b-ac64-5a19346fc709","Type":"ContainerDied","Data":"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"}
Sep 19 01:38:59.219013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.218898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn" event={"ID":"88f69691-7093-4e3b-ac64-5a19346fc709","Type":"ContainerDied","Data":"103cb04a60cfc9c784d9dd117b710e198538ffdd1095f0376d9669b5ca38bb7c"}
Sep 19 01:38:59.220256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.220224    2567 generic.go:356] "Generic (PLEG): container finished" podID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerID="a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6" exitCode=0
Sep 19 01:38:59.220347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.220260    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"
Sep 19 01:38:59.220347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.220282    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" event={"ID":"2c99a99c-0d54-464b-9887-d3936dd200b6","Type":"ContainerDied","Data":"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"}
Sep 19 01:38:59.220347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.220322    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" event={"ID":"2c99a99c-0d54-464b-9887-d3936dd200b6","Type":"ContainerDied","Data":"744a8df7b58e31000b933a1caaa40bb5cfe0d05225d5c8b894813a5958c10daa"}
Sep 19 01:38:59.228466 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.228447    2567 scope.go:117] "RemoveContainer" containerID="873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"
Sep 19 01:38:59.229016 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:59.228762    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5\": container with ID starting with 873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5 not found: ID does not exist" containerID="873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"
Sep 19 01:38:59.229016 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.228794    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5"} err="failed to get container status \"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5\": rpc error: code = NotFound desc = could not find container \"873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5\": container with ID starting with 873c5539739c87dea01e5bab31f25b54093e1f0a24391c98332ea60170073fe5 not found: ID does not exist"
Sep 19 01:38:59.229016 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.228811    2567 scope.go:117] "RemoveContainer" containerID="cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"
Sep 19 01:38:59.237041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.237022    2567 scope.go:117] "RemoveContainer" containerID="cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"
Sep 19 01:38:59.237304 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:59.237286    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1\": container with ID starting with cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1 not found: ID does not exist" containerID="cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"
Sep 19 01:38:59.237359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.237309    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1"} err="failed to get container status \"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1\": rpc error: code = NotFound desc = could not find container \"cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1\": container with ID starting with cd2679661dff7780611a7a5b72e0791b369f21aa51cd02bbf8dcb4e7a6a62eb1 not found: ID does not exist"
Sep 19 01:38:59.237359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.237323    2567 scope.go:117] "RemoveContainer" containerID="a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"
Sep 19 01:38:59.244888 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.244869    2567 scope.go:117] "RemoveContainer" containerID="a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"
Sep 19 01:38:59.245178 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:38:59.245155    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6\": container with ID starting with a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6 not found: ID does not exist" containerID="a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"
Sep 19 01:38:59.245287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.245181    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6"} err="failed to get container status \"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6\": rpc error: code = NotFound desc = could not find container \"a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6\": container with ID starting with a397298ad932ee12f0fe807234b6649ed0cf70622785ed8d333206996e6109f6 not found: ID does not exist"
Sep 19 01:38:59.249376 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.249355    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:38:59.256411 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.256391    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-0376cd-78856d948f-srtjn"]
Sep 19 01:38:59.276203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.276182    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:38:59.284732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.284708    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-0376cd-6487d7c9c4-fmshc"]
Sep 19 01:38:59.298970 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.298949    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:38:59.302061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.302039    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq"]
Sep 19 01:38:59.308697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.308667    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:38:59.937318 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:38:59.937227    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-0376cd-5ff8f67994-g6bfq" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.60:9004: i/o timeout"
Sep 19 01:39:00.141233 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:00.141199    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:00.921256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:00.921220    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" path="/var/lib/kubelet/pods/2c99a99c-0d54-464b-9887-d3936dd200b6/volumes"
Sep 19 01:39:00.921599 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:00.921586    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88f69691-7093-4e3b-ac64-5a19346fc709" path="/var/lib/kubelet/pods/88f69691-7093-4e3b-ac64-5a19346fc709/volumes"
Sep 19 01:39:00.921962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:00.921939    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" path="/var/lib/kubelet/pods/fb357433-fad5-4d1c-841e-42d8b0b3f4f6/volumes"
Sep 19 01:39:00.947056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:00.947027    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:05.076713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:05.076677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:05.177926 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:05.177894    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:05.318849 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:05.318820    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:39:05.319089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:05.319066    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy" containerID="cri-o://e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5" gracePeriod=30
Sep 19 01:39:05.345589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:05.345508    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:10.566188 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.566158    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:39:10.654041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.653974    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654066    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654098    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9ln7\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654128    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654166    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654219    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654273    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:39:10.654420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654282    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654311    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654355    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data\") pod \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\" (UID: \"1eb5cd9b-8da3-4324-adf9-fdc6069debf7\") "
Sep 19 01:39:10.654679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654523    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:39:10.654679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654538    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:39:10.654798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654692    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:39:10.654798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654713    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:39:10.654798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654733    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.654798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654748    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.654798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.654758    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.656440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.656411    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7" (OuterVolumeSpecName: "kube-api-access-j9ln7") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "kube-api-access-j9ln7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:39:10.656440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.656410    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:39:10.656575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.656482    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:39:10.656575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.656523    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1eb5cd9b-8da3-4324-adf9-fdc6069debf7" (UID: "1eb5cd9b-8da3-4324-adf9-fdc6069debf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:39:10.756071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756048    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.756071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756069    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9ln7\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-kube-api-access-j9ln7\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.756193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756080    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.756193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756088    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.756193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756107    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:10.756193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:10.756115    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1eb5cd9b-8da3-4324-adf9-fdc6069debf7-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:39:11.284618 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.284586    2567 generic.go:356] "Generic (PLEG): container finished" podID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerID="e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5" exitCode=0
Sep 19 01:39:11.284770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.284633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerDied","Data":"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"}
Sep 19 01:39:11.284770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.284679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq" event={"ID":"1eb5cd9b-8da3-4324-adf9-fdc6069debf7","Type":"ContainerDied","Data":"268d885e9bc1a2a558ce1036afcc72ad13eecf6801f4b63ba4baf91f326ee998"}
Sep 19 01:39:11.284770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.284700    2567 scope.go:117] "RemoveContainer" containerID="e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"
Sep 19 01:39:11.284770 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.284639    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"
Sep 19 01:39:11.293067 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.293047    2567 scope.go:117] "RemoveContainer" containerID="24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"
Sep 19 01:39:11.300986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.300847    2567 scope.go:117] "RemoveContainer" containerID="e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"
Sep 19 01:39:11.301324 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:39:11.301282    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5\": container with ID starting with e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5 not found: ID does not exist" containerID="e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"
Sep 19 01:39:11.301431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.301320    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5"} err="failed to get container status \"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5\": rpc error: code = NotFound desc = could not find container \"e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5\": container with ID starting with e4a6c60d56397a8b908b2eff31239fc2ef6a7ba7ae82cb3e249268071c74e6e5 not found: ID does not exist"
Sep 19 01:39:11.301431 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.301347    2567 scope.go:117] "RemoveContainer" containerID="24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"
Sep 19 01:39:11.301811 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:39:11.301784    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66\": container with ID starting with 24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66 not found: ID does not exist" containerID="24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"
Sep 19 01:39:11.301983 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.301816    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66"} err="failed to get container status \"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66\": rpc error: code = NotFound desc = could not find container \"24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66\": container with ID starting with 24a88e2b1fd5c01f7a2aa694fd2684ad4bde761de365596dd7e54eb3ede6ef66 not found: ID does not exist"
Sep 19 01:39:11.303889 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.303869    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:39:11.309360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:11.309340    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-0376cd-openshift-default-7f95dc667d-54hrq"]
Sep 19 01:39:12.920648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:12.920612    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" path="/var/lib/kubelet/pods/1eb5cd9b-8da3-4324-adf9-fdc6069debf7/volumes"
Sep 19 01:39:13.095014 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:13.094975    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:14.033234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:14.033186    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:25.393019 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.392935    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:39:25.393483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393487    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393501    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88f69691-7093-4e3b-ac64-5a19346fc709" containerName="payload-processing"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393510    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="88f69691-7093-4e3b-ac64-5a19346fc709" containerName="payload-processing"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393525    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerName="payload-pre-processing"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393535    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerName="payload-pre-processing"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393556    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" containerName="payload-processing"
Sep 19 01:39:25.393574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393564    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393579    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" containerName="maas-api"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393588    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" containerName="maas-api"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393598    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf09bc5b-6819-47a2-9ad8-c730c461e239" containerName="payload-pre-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393606    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf09bc5b-6819-47a2-9ad8-c730c461e239" containerName="payload-pre-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393624    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393632    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393645    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393653    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393664    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393672    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393767    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393778    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7fb3793-b499-4e98-9ca0-52e463dbbcf9" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393785    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf09bc5b-6819-47a2-9ad8-c730c461e239" containerName="payload-pre-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393795    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb357433-fad5-4d1c-841e-42d8b0b3f4f6" containerName="maas-api"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393805    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b29b7e38-3ca3-4f4a-b676-b419bb7d3b63" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393814    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="88f69691-7093-4e3b-ac64-5a19346fc709" containerName="payload-processing"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393825    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393833    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eb5cd9b-8da3-4324-adf9-fdc6069debf7" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393843    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:39:25.393951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.393851    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c99a99c-0d54-464b-9887-d3936dd200b6" containerName="payload-pre-processing"
Sep 19 01:39:25.397121 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.397101    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.400042 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.400023    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-751f6a\"/\"openshift-service-ca.crt\""
Sep 19 01:39:25.400151 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.400037    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-751f6a\"/\"kube-root-ca.crt\""
Sep 19 01:39:25.400992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.400975    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-751f6a\"/\"default-dockercfg-nxcm6\""
Sep 19 01:39:25.401087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.401049    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-751f6a\"/\"rate-test-model-751f6a-kserve-self-signed-certs\""
Sep 19 01:39:25.409352 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.409330    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:39:25.428642 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.428610    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:39:25.578317 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578283    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.578464 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.578464 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578388    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.578464 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.578588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578476    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vqv4\" (UniqueName: \"kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.578588 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.578546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.679956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680046    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680222 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vqv4\" (UniqueName: \"kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680466 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680529 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680487    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.680582 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.680526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.682213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.682190    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.682460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.682443    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.688751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.688727    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vqv4\" (UniqueName: \"kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4\") pod \"rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") " pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.707106 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.707083    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:25.980445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:25.980415    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:39:25.981319 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:39:25.981291    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbefe51c_340c_420a_a775_c844ee2e0d68.slice/crio-34522ecdbf227d41858166bbdcaaa314feb161e9f19120edd1e5d97e1ca15831 WatchSource:0}: Error finding container 34522ecdbf227d41858166bbdcaaa314feb161e9f19120edd1e5d97e1ca15831: Status 404 returned error can't find the container with id 34522ecdbf227d41858166bbdcaaa314feb161e9f19120edd1e5d97e1ca15831
Sep 19 01:39:26.362156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:26.362114    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" event={"ID":"cbefe51c-340c-420a-a775-c844ee2e0d68","Type":"ContainerStarted","Data":"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"}
Sep 19 01:39:26.362307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:26.362165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" event={"ID":"cbefe51c-340c-420a-a775-c844ee2e0d68","Type":"ContainerStarted","Data":"34522ecdbf227d41858166bbdcaaa314feb161e9f19120edd1e5d97e1ca15831"}
Sep 19 01:39:26.381654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:26.381603    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" podStartSLOduration=1.381587937 podStartE2EDuration="1.381587937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:39:26.380555691 +0000 UTC m=+1613.722003615" watchObservedRunningTime="2026-09-19 01:39:26.381587937 +0000 UTC m=+1613.723035887"
Sep 19 01:39:35.707210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:35.707167    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:35.707721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:35.707223    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:35.719440 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:35.719416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:36.421582 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:36.421547    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:39:44.837529 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:39:44.837489    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:22.006348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:22.006311    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:40:22.034422 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:22.034396    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:23.177242 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.177207    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:23.583483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.583443    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:23.902460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.902373    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:40:23.902998 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.902982    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:40:23.903050 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.903002    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa97960-18d9-4b81-bd14-aa80c2b0097a" containerName="istio-proxy"
Sep 19 01:40:23.906727 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.906707    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.909906 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.909883    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a4edd7-openshift-default-dockercfg-x6t24\""
Sep 19 01:40:23.918757 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.918737    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:40:23.932579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.932544    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:23.996581 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.996549    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997061 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2cm8\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997259 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997242    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997425 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997563    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997718 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997809 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997833    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:23.997945 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:23.997879    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099429    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099498    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2cm8\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099527    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099562    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099637    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.099859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.099787    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.100112 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.100047    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.100234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.100211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.100319 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.100297    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.100499 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.100479    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.102210 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.102188    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.102494 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.102474    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.109676 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.109648    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.110029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.110008    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2cm8\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8\") pod \"e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") " pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.217295 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.217227    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:24.226047 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.226020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:24.510979 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.510949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:40:24.511961 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:40:24.511927    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001c9bf5_0486_4bf2_9e1d_62cf73959d77.slice/crio-2b8914d62d169369de760491737eb7cbfc2978664795f22918433787ef2a304e WatchSource:0}: Error finding container 2b8914d62d169369de760491737eb7cbfc2978664795f22918433787ef2a304e: Status 404 returned error can't find the container with id 2b8914d62d169369de760491737eb7cbfc2978664795f22918433787ef2a304e
Sep 19 01:40:24.514358 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.514326    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:24.514484 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.514390    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:24.514484 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.514420    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:24.637679 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.637636    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerStarted","Data":"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"}
Sep 19 01:40:24.637858 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.637703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerStarted","Data":"2b8914d62d169369de760491737eb7cbfc2978664795f22918433787ef2a304e"}
Sep 19 01:40:24.659951 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:24.659882    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podStartSLOduration=1.659864467 podStartE2EDuration="1.659864467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:24.659427514 +0000 UTC m=+1672.000875451" watchObservedRunningTime="2026-09-19 01:40:24.659864467 +0000 UTC m=+1672.001312390"
Sep 19 01:40:25.218192 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:25.218162    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:25.222992 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:25.222966    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:25.642995 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:25.642965    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:25.643798 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:25.643778    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:26.014762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:26.014686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:26.674461 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:26.674423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:26.861563 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:26.861533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:27.184854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:27.184814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:28.237039 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:28.237003    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:28.949193 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:28.949161    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:29.027510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.027474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:29.127099 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.127058    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:29.515452 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.515418    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:29.657052 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.657015    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:29.773149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.773080    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:40:29.776585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.776558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.780196 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.780179    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a4edd7-dockercfg-mgg76\""
Sep 19 01:40:29.780272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.780252    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a4edd7\""
Sep 19 01:40:29.814454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.814426    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:40:29.852326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.852304    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.852450 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.852356    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jttcr\" (UniqueName: \"kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.855337 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.855309    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:40:29.859300 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.859281    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:29.893307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.893275    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:40:29.953120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.953084    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:29.953294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.953142    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jttcr\" (UniqueName: \"kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.953294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.953277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd95w\" (UniqueName: \"kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:29.953370 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.953313    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.953998 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.953980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:29.968088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:29.968067    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jttcr\" (UniqueName: \"kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr\") pod \"payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:30.054030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.053985    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd95w\" (UniqueName: \"kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.054202 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.054057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.054703 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.054684    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.076551 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.076522    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd95w\" (UniqueName: \"kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w\") pod \"payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.087433 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.087403    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:30.168161 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.168132    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.363029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.363002    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:40:30.364676 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:40:30.364647    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda432097a_3371_4cb8_9e09_b0f11f43d8c0.slice/crio-a101b79cee6cbcc057e574108ec2970684fead8c1085b485fe5ca46312466afb WatchSource:0}: Error finding container a101b79cee6cbcc057e574108ec2970684fead8c1085b485fe5ca46312466afb: Status 404 returned error can't find the container with id a101b79cee6cbcc057e574108ec2970684fead8c1085b485fe5ca46312466afb
Sep 19 01:40:30.446230 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.446202    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:40:30.447990 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:40:30.447959    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd500113_74d4_4784_89cd_b261e0c0cd3d.slice/crio-8f909e42c253ae75a17acc656b1312bb34b260ff78fe743eea4a7df1b124e746 WatchSource:0}: Error finding container 8f909e42c253ae75a17acc656b1312bb34b260ff78fe743eea4a7df1b124e746: Status 404 returned error can't find the container with id 8f909e42c253ae75a17acc656b1312bb34b260ff78fe743eea4a7df1b124e746
Sep 19 01:40:30.667398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.667300    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" event={"ID":"a432097a-3371-4cb8-9e09-b0f11f43d8c0","Type":"ContainerStarted","Data":"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"}
Sep 19 01:40:30.667398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.667370    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:30.667398 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.667395    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" event={"ID":"a432097a-3371-4cb8-9e09-b0f11f43d8c0","Type":"ContainerStarted","Data":"a101b79cee6cbcc057e574108ec2970684fead8c1085b485fe5ca46312466afb"}
Sep 19 01:40:30.668962 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.668934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" event={"ID":"fd500113-74d4-4784-89cd-b261e0c0cd3d","Type":"ContainerStarted","Data":"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"}
Sep 19 01:40:30.669090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.668980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" event={"ID":"fd500113-74d4-4784-89cd-b261e0c0cd3d","Type":"ContainerStarted","Data":"8f909e42c253ae75a17acc656b1312bb34b260ff78fe743eea4a7df1b124e746"}
Sep 19 01:40:30.669090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.669001    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:30.687648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.687607    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" podStartSLOduration=1.687594646 podStartE2EDuration="1.687594646s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:30.685796848 +0000 UTC m=+1678.027244776" watchObservedRunningTime="2026-09-19 01:40:30.687594646 +0000 UTC m=+1678.029042599"
Sep 19 01:40:30.704359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:30.704305    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" podStartSLOduration=1.704288281 podStartE2EDuration="1.704288281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:30.704079104 +0000 UTC m=+1678.045527040" watchObservedRunningTime="2026-09-19 01:40:30.704288281 +0000 UTC m=+1678.045736205"
Sep 19 01:40:37.025330 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.025277    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" podUID="cbefe51c-340c-420a-a775-c844ee2e0d68" containerName="main" containerID="cri-o://4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92" gracePeriod=45
Sep 19 01:40:37.282623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.282600    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:40:37.436894 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.436860    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.436911    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.436998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vqv4\" (UniqueName: \"kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437037    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437062    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437089 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437079    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm\") pod \"cbefe51c-340c-420a-a775-c844ee2e0d68\" (UID: \"cbefe51c-340c-420a-a775-c844ee2e0d68\") "
Sep 19 01:40:37.437302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437151    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:40:37.437302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437184    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home" (OuterVolumeSpecName: "home") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:40:37.437302 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437235    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:40:37.437424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437407    2567 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-home\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.437424 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437419    2567 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-tmp-dir\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.437539 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.437430    2567 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-model-cache\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.439448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.439422    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:40:37.439448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.439432    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm" (OuterVolumeSpecName: "dshm") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:40:37.439448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.439441    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4" (OuterVolumeSpecName: "kube-api-access-4vqv4") pod "cbefe51c-340c-420a-a775-c844ee2e0d68" (UID: "cbefe51c-340c-420a-a775-c844ee2e0d68"). InnerVolumeSpecName "kube-api-access-4vqv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:40:37.538489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.538395    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vqv4\" (UniqueName: \"kubernetes.io/projected/cbefe51c-340c-420a-a775-c844ee2e0d68-kube-api-access-4vqv4\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.538489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.538429    2567 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbefe51c-340c-420a-a775-c844ee2e0d68-tls-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.538489 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.538442    2567 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbefe51c-340c-420a-a775-c844ee2e0d68-dshm\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:40:37.708694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.708646    2567 generic.go:356] "Generic (PLEG): container finished" podID="cbefe51c-340c-420a-a775-c844ee2e0d68" containerID="4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92" exitCode=0
Sep 19 01:40:37.708867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.708770    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" event={"ID":"cbefe51c-340c-420a-a775-c844ee2e0d68","Type":"ContainerDied","Data":"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"}
Sep 19 01:40:37.708867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.708808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq" event={"ID":"cbefe51c-340c-420a-a775-c844ee2e0d68","Type":"ContainerDied","Data":"34522ecdbf227d41858166bbdcaaa314feb161e9f19120edd1e5d97e1ca15831"}
Sep 19 01:40:37.708867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.708833    2567 scope.go:117] "RemoveContainer" containerID="4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"
Sep 19 01:40:37.709105 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.709033    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"
Sep 19 01:40:37.730330 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.730308    2567 scope.go:117] "RemoveContainer" containerID="4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"
Sep 19 01:40:37.730661 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:40:37.730642    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92\": container with ID starting with 4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92 not found: ID does not exist" containerID="4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"
Sep 19 01:40:37.730704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.730672    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92"} err="failed to get container status \"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92\": rpc error: code = NotFound desc = could not find container \"4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92\": container with ID starting with 4b58e222403d7b2a799e4fb9d05f6d81bbcb2814d0a46f665703bc0a3100fe92 not found: ID does not exist"
Sep 19 01:40:37.740113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.740081    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:40:37.744211 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:37.744188    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-751f6a/rate-test-model-751f6a-kserve-6c44fc8cff-2vtkq"]
Sep 19 01:40:38.924644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:38.924605    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbefe51c-340c-420a-a775-c844ee2e0d68" path="/var/lib/kubelet/pods/cbefe51c-340c-420a-a775-c844ee2e0d68/volumes"
Sep 19 01:40:41.676100 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:41.676061    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:40:41.676538 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:41.676150    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:40:41.684027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:41.684002    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 01:40:41.684165 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:41.684059    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 01:40:42.739142 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.739111    2567 generic.go:356] "Generic (PLEG): container finished" podID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerID="4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac" exitCode=0
Sep 19 01:40:42.739655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.739192    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerDied","Data":"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"}
Sep 19 01:40:42.739733 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.739655    2567 scope.go:117] "RemoveContainer" containerID="4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"
Sep 19 01:40:42.740821 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.740793    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:42.740931 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.740859    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:42.740931 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:42.740897    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:43.747343 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:43.747307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerStarted","Data":"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"}
Sep 19 01:40:44.217732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:44.217689    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:44.218127 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:44.218096    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 19 01:40:44.218234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:44.218174    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 19 01:40:44.250557 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:44.250525    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:45.218053 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:45.218017    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 19 01:40:45.218537 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:45.218090    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 19 01:40:46.217982 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:46.217943    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 19 01:40:46.218274 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:46.218247    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 19 01:40:47.218340 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:47.218252    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 19 01:40:47.218908 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:47.218877    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 19 01:40:48.218269 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:48.218232    2567 patch_prober.go:28] interesting pod/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Sep 19 01:40:48.218565 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:48.218537    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Sep 19 01:40:49.221934 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:49.221888    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:49.222284 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:49.222210    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:49.222800 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:49.222783    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:40:53.033892 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:53.033857    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:53.936231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:53.936193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:54.923029 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:54.922992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:55.633120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:55.633087    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:56.774274 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:56.774235    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:57.436198 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.436166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:57.774877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.774803    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:40:57.775227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.775218    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbefe51c-340c-420a-a775-c844ee2e0d68" containerName="main"
Sep 19 01:40:57.775272 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.775229    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbefe51c-340c-420a-a775-c844ee2e0d68" containerName="main"
Sep 19 01:40:57.775307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.775289    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbefe51c-340c-420a-a775-c844ee2e0d68" containerName="main"
Sep 19 01:40:57.777293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.777277    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.780225 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.780205    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-14de36-openshift-default-dockercfg-xfhh7\""
Sep 19 01:40:57.809360 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.809330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:57.837885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.837844    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.837894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838036    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838149    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838213 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl2bc\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838241    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838271    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.838384 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.838312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.875425 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.875349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:40:57.939758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.939730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.939758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.939761    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.939948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940195    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940302    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940377    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940493 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940475    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl2bc\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940310    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940665 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940701    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.940779 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.940720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.941256 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.941230    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.942991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.942970    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.943559 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.943538    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.956013 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.955988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:57.956639 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:57.956617    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl2bc\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc\") pod \"e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") " pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:58.081362 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.081321    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:40:58.087330 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.087304    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:58.369447 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.369422    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:40:58.369962 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:40:58.369936    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5704979_2e85_4892_8f71_1582be58ca13.slice/crio-eaa282ccf3196465113478dfe6f8605fb6f464ad8e8c2aa888adb7bbdab0214b WatchSource:0}: Error finding container eaa282ccf3196465113478dfe6f8605fb6f464ad8e8c2aa888adb7bbdab0214b: Status 404 returned error can't find the container with id eaa282ccf3196465113478dfe6f8605fb6f464ad8e8c2aa888adb7bbdab0214b
Sep 19 01:40:58.372320 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.372284    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:58.372420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.372350    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:58.372420 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.372380    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:40:58.824456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.824424    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerStarted","Data":"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"}
Sep 19 01:40:58.824841 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.824485    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerStarted","Data":"eaa282ccf3196465113478dfe6f8605fb6f464ad8e8c2aa888adb7bbdab0214b"}
Sep 19 01:40:58.846149 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:58.845746    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podStartSLOduration=1.84572177 podStartE2EDuration="1.84572177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:40:58.845560115 +0000 UTC m=+1706.187008037" watchObservedRunningTime="2026-09-19 01:40:58.84572177 +0000 UTC m=+1706.187169694"
Sep 19 01:40:59.088070 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:59.087985    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:59.093275 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:59.093246    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:59.829315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:59.829284    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:40:59.830179 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:40:59.830158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:41:00.170102 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:00.169992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:00.837861 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:00.837824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:00.949458 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:00.949427    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:01.151537 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:01.151458    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:01.993246 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:01.993198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:02.910597 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:02.910551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:03.710601 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:03.710564    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:03.811140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:03.811110    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:03.883527 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:03.883495    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:04.234860 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.234824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:04.331664 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.331625    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:04.488060 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.487976    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:41:04.491335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.491308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.494789 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.494769    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-14de36-dockercfg-f9vdn\""
Sep 19 01:41:04.495568 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.495504    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-14de36\""
Sep 19 01:41:04.506897 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.506871    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:41:04.602853 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.602824    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f86ng\" (UniqueName: \"kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.603000 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.602893    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.704280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.704252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f86ng\" (UniqueName: \"kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.704407 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.704307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.704938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.704903    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.712997 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.712975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f86ng\" (UniqueName: \"kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng\") pod \"payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:04.811481 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:04.811462    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:05.083838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:05.083813    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:41:05.085643 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:41:05.085614    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e434f9_09cf_4037_8bc7_095968301bab.slice/crio-ad017f59c3e2fac67bf5cd312dcaa6f1fd001a05be80f0ebb51fb4b86960dfbb WatchSource:0}: Error finding container ad017f59c3e2fac67bf5cd312dcaa6f1fd001a05be80f0ebb51fb4b86960dfbb: Status 404 returned error can't find the container with id ad017f59c3e2fac67bf5cd312dcaa6f1fd001a05be80f0ebb51fb4b86960dfbb
Sep 19 01:41:05.861510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:05.861464    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" event={"ID":"a9e434f9-09cf-4037-8bc7-095968301bab","Type":"ContainerStarted","Data":"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"}
Sep 19 01:41:05.861876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:05.861523    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" event={"ID":"a9e434f9-09cf-4037-8bc7-095968301bab","Type":"ContainerStarted","Data":"ad017f59c3e2fac67bf5cd312dcaa6f1fd001a05be80f0ebb51fb4b86960dfbb"}
Sep 19 01:41:05.861876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:05.861571    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:05.881028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:05.880983    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" podStartSLOduration=1.880968465 podStartE2EDuration="1.880968465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:41:05.879222645 +0000 UTC m=+1713.220670557" watchObservedRunningTime="2026-09-19 01:41:05.880968465 +0000 UTC m=+1713.222416388"
Sep 19 01:41:16.869183 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:16.869145    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:41:18.942892 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.942858    2567 generic.go:356] "Generic (PLEG): container finished" podID="f5704979-2e85-4892-8f71-1582be58ca13" containerID="6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0" exitCode=0
Sep 19 01:41:18.942892 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.942897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerDied","Data":"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"}
Sep 19 01:41:18.943372 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.943285    2567 scope.go:117] "RemoveContainer" containerID="6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"
Sep 19 01:41:18.944393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.944361    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:41:18.944456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.944436    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:41:18.944495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:18.944474    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:41:19.950460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:19.950427    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerStarted","Data":"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"}
Sep 19 01:41:20.088094 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:20.088063    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:41:20.088280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:20.088259    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 19 01:41:20.088326 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:20.088312    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 19 01:41:21.088408 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:21.088375    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 19 01:41:21.088793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:21.088435    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 19 01:41:22.088152 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:22.088118    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 19 01:41:22.088335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:22.088171    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 19 01:41:23.088575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:23.088536    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 19 01:41:23.089100 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:23.088601    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 19 01:41:24.088216 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:24.088175    2567 patch_prober.go:28] interesting pod/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 19 01:41:24.088466 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:24.088234    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 19 01:41:25.091322 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:25.091288    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:41:25.091705 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:25.091565    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:41:25.092203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:25.092185    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:41:26.652449 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:26.652413    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:27.432715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:27.432676    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:28.176701 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:28.176666    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:28.925973 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:28.925932    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:29.664333 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:29.664297    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:30.998883 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:30.998850    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:36.408355 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:36.408324    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh_a9e434f9-09cf-4037-8bc7-095968301bab/payload-processing/0.log"
Sep 19 01:41:42.725022 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:42.724973    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:41:53.929270 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:41:53.929230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:19.967090 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:19.967019    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc_fd500113-74d4-4784-89cd-b261e0c0cd3d/payload-processing/0.log"
Sep 19 01:42:20.236157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:20.236087    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh_a9e434f9-09cf-4037-8bc7-095968301bab/payload-processing/0.log"
Sep 19 01:42:20.360644 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:20.360619    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh_a9e434f9-09cf-4037-8bc7-095968301bab/payload-processing/0.log"
Sep 19 01:42:20.702567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:20.702529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:21.071453 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.071419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:42:21.075026 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.075010    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.080759 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.080737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-df8e58-openshift-default-dockercfg-8x6k8\""
Sep 19 01:42:21.090548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.090527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:42:21.134619 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.134587    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:21.135459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135571 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135571 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135508    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135653 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135552    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135682    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135847 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.135903 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.135875    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkbv9\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.228427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.228389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:21.236646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236614    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.236768 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236652    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.236768 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkbv9\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.236768 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.236768 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236764    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.236861    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237040    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237127    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237168    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237249    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237331    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.237553 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.237533    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.239248 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.239218    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.239382 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.239364    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.254608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.248956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkbv9\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.254608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.251644    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token\") pod \"e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") " pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.385212 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.385138    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:21.692938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.692896    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:42:21.695060 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:42:21.695031    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1069804f_cbdf_4498_b174_5cca8261dc03.slice/crio-2da3645c518c685f7ae77634e8bb9f614a720675473bcead141df266fb01ba3c WatchSource:0}: Error finding container 2da3645c518c685f7ae77634e8bb9f614a720675473bcead141df266fb01ba3c: Status 404 returned error can't find the container with id 2da3645c518c685f7ae77634e8bb9f614a720675473bcead141df266fb01ba3c
Sep 19 01:42:21.697784 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.697748    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:21.697874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.697814    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:21.697874 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:21.697845    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:22.259780 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:22.259746    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerStarted","Data":"117e1f1f9dbc2f70b554797109210309a92cf51bb0b6cc14f7b8426b21245ce1"}
Sep 19 01:42:22.260169 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:22.259795    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerStarted","Data":"2da3645c518c685f7ae77634e8bb9f614a720675473bcead141df266fb01ba3c"}
Sep 19 01:42:22.286145 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:22.286089    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podStartSLOduration=1.286070856 podStartE2EDuration="1.286070856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:22.285499299 +0000 UTC m=+1789.626947223" watchObservedRunningTime="2026-09-19 01:42:22.286070856 +0000 UTC m=+1789.627518781"
Sep 19 01:42:22.385633 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:22.385606    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:22.390694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:22.390670    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:23.264241 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:23.264214    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:23.265174 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:23.265158    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:23.623216 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:23.623181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:24.258166 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:24.258137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:24.372293 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:24.372263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:24.478044 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:24.478014    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:25.179072 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:25.179032    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:26.093573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:26.093536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:27.040411 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:27.040375    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:27.563487 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:27.563456    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:27.656654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:27.656626    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:27.759338 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:27.759307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:27.857830 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:27.857752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:28.234755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.234668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:28.319391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.319348    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:28.376857 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.376824    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:42:28.380524 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.380499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.383475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.383455    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-df8e58\""
Sep 19 01:42:28.383648 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.383629    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-df8e58-dockercfg-7mld8\""
Sep 19 01:42:28.393022 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.393003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:42:28.505658 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.505571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p97w\" (UniqueName: \"kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.505806 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.505694    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.607157 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.607117    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p97w\" (UniqueName: \"kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.607516 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.607193    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.607890 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.607871    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.619533 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.619509    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p97w\" (UniqueName: \"kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w\") pod \"payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.692579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.692555    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:28.963806 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:28.963781    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:42:28.965418 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:42:28.965391    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2262a7ff_fba7_4768_b162_5670a232a3f3.slice/crio-8fa8cb10c95c755d147269a751fc48d941d3e803095f1ef6f510145e18066999 WatchSource:0}: Error finding container 8fa8cb10c95c755d147269a751fc48d941d3e803095f1ef6f510145e18066999: Status 404 returned error can't find the container with id 8fa8cb10c95c755d147269a751fc48d941d3e803095f1ef6f510145e18066999
Sep 19 01:42:29.298348 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:29.298310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" event={"ID":"2262a7ff-fba7-4768-b162-5670a232a3f3","Type":"ContainerStarted","Data":"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"}
Sep 19 01:42:29.298528 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:29.298402    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" event={"ID":"2262a7ff-fba7-4768-b162-5670a232a3f3","Type":"ContainerStarted","Data":"8fa8cb10c95c755d147269a751fc48d941d3e803095f1ef6f510145e18066999"}
Sep 19 01:42:29.298629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:29.298601    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:29.325458 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:29.325413    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" podStartSLOduration=1.3254005150000001 podStartE2EDuration="1.325400515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:42:29.323897649 +0000 UTC m=+1796.665345573" watchObservedRunningTime="2026-09-19 01:42:29.325400515 +0000 UTC m=+1796.666848437"
Sep 19 01:42:35.039988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:35.039957    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:42:35.042975 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:35.042954    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:42:40.307107 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:40.307076    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:42:44.386662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.386630    2567 generic.go:356] "Generic (PLEG): container finished" podID="1069804f-cbdf-4498-b174-5cca8261dc03" containerID="117e1f1f9dbc2f70b554797109210309a92cf51bb0b6cc14f7b8426b21245ce1" exitCode=0
Sep 19 01:42:44.387285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.386708    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerDied","Data":"117e1f1f9dbc2f70b554797109210309a92cf51bb0b6cc14f7b8426b21245ce1"}
Sep 19 01:42:44.387285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.387148    2567 scope.go:117] "RemoveContainer" containerID="117e1f1f9dbc2f70b554797109210309a92cf51bb0b6cc14f7b8426b21245ce1"
Sep 19 01:42:44.388203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.388170    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:44.388278 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.388246    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:44.388359 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:44.388282    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 19 01:42:45.394003 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:45.393969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerStarted","Data":"f85aafe9ff10ca9e61832af6a84cdc83ecfa866363f6d3f451b4aa00882993d4"}
Sep 19 01:42:46.385978 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:46.385946    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:46.386191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:46.386169    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 19 01:42:46.386255 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:46.386232    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 19 01:42:47.385684 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:47.385649    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 19 01:42:47.386088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:47.385701    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 19 01:42:48.385710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:48.385675    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 19 01:42:48.386122 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:48.385726    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 19 01:42:49.385884 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:49.385849    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 19 01:42:49.386285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:49.385900    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 19 01:42:50.385714 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:50.385678    2567 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 19 01:42:50.385885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:50.385740    2567 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 19 01:42:51.152374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:51.152341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:51.389455 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:51.389423    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:51.389700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:51.389678    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:51.390305 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:51.390289    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:42:52.252567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:52.252537    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:52.889476 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:52.889441    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:53.684735 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:53.684698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:54.466088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:54.466057    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:54.565521 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:54.565488    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:55.222334 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:55.222291    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:56.033130 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:56.033094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:56.793739 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:56.793708    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:57.463369 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:57.463329    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:58.231726 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:58.231689    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:58.935622 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:58.935586    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:42:59.629811 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:42:59.629776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.050859 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.050824    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.097933 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.097894    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:43:06.098165 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.098140    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" podUID="2262a7ff-fba7-4768-b162-5670a232a3f3" containerName="payload-processing" containerID="cri-o://8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56" gracePeriod=30
Sep 19 01:43:06.149716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.149680    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.250592 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.250554    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.347721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.347698    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:43:06.349930 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.349873    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.491694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.491665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p97w\" (UniqueName: \"kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w\") pod \"2262a7ff-fba7-4768-b162-5670a232a3f3\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") "
Sep 19 01:43:06.491871 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.491766    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume\") pod \"2262a7ff-fba7-4768-b162-5670a232a3f3\" (UID: \"2262a7ff-fba7-4768-b162-5670a232a3f3\") "
Sep 19 01:43:06.492156 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.492135    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2262a7ff-fba7-4768-b162-5670a232a3f3" (UID: "2262a7ff-fba7-4768-b162-5670a232a3f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:43:06.493746 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.493724    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w" (OuterVolumeSpecName: "kube-api-access-9p97w") pod "2262a7ff-fba7-4768-b162-5670a232a3f3" (UID: "2262a7ff-fba7-4768-b162-5670a232a3f3"). InnerVolumeSpecName "kube-api-access-9p97w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:43:06.511456 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.511433    2567 generic.go:356] "Generic (PLEG): container finished" podID="2262a7ff-fba7-4768-b162-5670a232a3f3" containerID="8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56" exitCode=0
Sep 19 01:43:06.511548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.511475    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"
Sep 19 01:43:06.511548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.511509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" event={"ID":"2262a7ff-fba7-4768-b162-5670a232a3f3","Type":"ContainerDied","Data":"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"}
Sep 19 01:43:06.511641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.511559    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x" event={"ID":"2262a7ff-fba7-4768-b162-5670a232a3f3","Type":"ContainerDied","Data":"8fa8cb10c95c755d147269a751fc48d941d3e803095f1ef6f510145e18066999"}
Sep 19 01:43:06.511641 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.511582    2567 scope.go:117] "RemoveContainer" containerID="8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"
Sep 19 01:43:06.520932 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.520897    2567 scope.go:117] "RemoveContainer" containerID="8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"
Sep 19 01:43:06.521223 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:43:06.521201    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56\": container with ID starting with 8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56 not found: ID does not exist" containerID="8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"
Sep 19 01:43:06.521280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.521232    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56"} err="failed to get container status \"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56\": rpc error: code = NotFound desc = could not find container \"8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56\": container with ID starting with 8e0ee8bbcd2a66c605d1aad60a5eccc9eaf2e74028b83eca123d7841f2fafa56 not found: ID does not exist"
Sep 19 01:43:06.533876 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.533854    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:43:06.536014 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.535995    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-df8e58-7b856cfc8c-qf28x"]
Sep 19 01:43:06.592720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.592660    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p97w\" (UniqueName: \"kubernetes.io/projected/2262a7ff-fba7-4768-b162-5670a232a3f3-kube-api-access-9p97w\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:06.592720 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.592685    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2262a7ff-fba7-4768-b162-5670a232a3f3-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:06.685545 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.685518    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.789220 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.789191    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:06.921700 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:06.921619    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2262a7ff-fba7-4768-b162-5670a232a3f3" path="/var/lib/kubelet/pods/2262a7ff-fba7-4768-b162-5670a232a3f3/volumes"
Sep 19 01:43:07.419927 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:07.419875    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:08.219835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:08.219801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:08.914713 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:08.914680    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:09.614856 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:09.614822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:13.081782 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:13.081740    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:13.211300 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:13.211267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:13.395683 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:13.395602    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:43:13.395838 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:13.395811    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy" containerID="cri-o://f85aafe9ff10ca9e61832af6a84cdc83ecfa866363f6d3f451b4aa00882993d4" gracePeriod=30
Sep 19 01:43:13.464067 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:13.464029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:17.443356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:17.443324    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:18.219393 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.219354    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:18.576363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.576322    2567 generic.go:356] "Generic (PLEG): container finished" podID="1069804f-cbdf-4498-b174-5cca8261dc03" containerID="f85aafe9ff10ca9e61832af6a84cdc83ecfa866363f6d3f451b4aa00882993d4" exitCode=0
Sep 19 01:43:18.576772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.576394    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerDied","Data":"f85aafe9ff10ca9e61832af6a84cdc83ecfa866363f6d3f451b4aa00882993d4"}
Sep 19 01:43:18.576772 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.576454    2567 scope.go:117] "RemoveContainer" containerID="117e1f1f9dbc2f70b554797109210309a92cf51bb0b6cc14f7b8426b21245ce1"
Sep 19 01:43:18.645835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.645815    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:43:18.804512 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804483    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804531    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804559    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804595    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804614    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804635    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkbv9\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.804675 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804670    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.805020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804705    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.805020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804747    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo\") pod \"1069804f-cbdf-4498-b174-5cca8261dc03\" (UID: \"1069804f-cbdf-4498-b174-5cca8261dc03\") "
Sep 19 01:43:18.805020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804778    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data" (OuterVolumeSpecName: "istio-data") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:43:18.805020 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.804859    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805029    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805147    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805183    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805200    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805147    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:43:18.805226 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.805153    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:43:18.806990 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.806959    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:43:18.807101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.807048    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token" (OuterVolumeSpecName: "istio-token") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:43:18.807101 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.807048    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9" (OuterVolumeSpecName: "kube-api-access-rkbv9") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "kube-api-access-rkbv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:43:18.807190 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.807126    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1069804f-cbdf-4498-b174-5cca8261dc03" (UID: "1069804f-cbdf-4498-b174-5cca8261dc03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:43:18.906434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906403    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1069804f-cbdf-4498-b174-5cca8261dc03-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.906434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906429    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkbv9\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-kube-api-access-rkbv9\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.906434 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906438    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.906638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906446    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1069804f-cbdf-4498-b174-5cca8261dc03-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.906638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906454    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1069804f-cbdf-4498-b174-5cca8261dc03-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.906638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.906462    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1069804f-cbdf-4498-b174-5cca8261dc03-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:18.985027 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:18.984999    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:19.583708 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.583677    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw" event={"ID":"1069804f-cbdf-4498-b174-5cca8261dc03","Type":"ContainerDied","Data":"2da3645c518c685f7ae77634e8bb9f614a720675473bcead141df266fb01ba3c"}
Sep 19 01:43:19.584109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.583737    2567 scope.go:117] "RemoveContainer" containerID="f85aafe9ff10ca9e61832af6a84cdc83ecfa866363f6d3f451b4aa00882993d4"
Sep 19 01:43:19.584109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.583689    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"
Sep 19 01:43:19.604234 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.604206    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:43:19.607480 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.607458    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-df8e58-openshift-default-55554f5c5b-zfddw"]
Sep 19 01:43:19.710449 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:19.710417    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:20.417432 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:20.417391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:20.921564 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:20.921532    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" path="/var/lib/kubelet/pods/1069804f-cbdf-4498-b174-5cca8261dc03/volumes"
Sep 19 01:43:21.169091 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:21.169057    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:26.634280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:26.634247    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:27.509022 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:27.508992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.218410 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.218376    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.259867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.259833    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:43:33.260168 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.260136    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" podUID="fd500113-74d4-4784-89cd-b261e0c0cd3d" containerName="payload-processing" containerID="cri-o://41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3" gracePeriod=30
Sep 19 01:43:33.274755 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.274731    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:43:33.315309 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.315259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.415550 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.415501    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.495826 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.495725    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.546887 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.546853    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:43:33.647715 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.647684    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume\") pod \"fd500113-74d4-4784-89cd-b261e0c0cd3d\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") "
Sep 19 01:43:33.647864 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.647748    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd95w\" (UniqueName: \"kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w\") pod \"fd500113-74d4-4784-89cd-b261e0c0cd3d\" (UID: \"fd500113-74d4-4784-89cd-b261e0c0cd3d\") "
Sep 19 01:43:33.648069 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.648049    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fd500113-74d4-4784-89cd-b261e0c0cd3d" (UID: "fd500113-74d4-4784-89cd-b261e0c0cd3d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:43:33.649748 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.649728    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w" (OuterVolumeSpecName: "kube-api-access-cd95w") pod "fd500113-74d4-4784-89cd-b261e0c0cd3d" (UID: "fd500113-74d4-4784-89cd-b261e0c0cd3d"). InnerVolumeSpecName "kube-api-access-cd95w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:43:33.658650 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658625    2567 generic.go:356] "Generic (PLEG): container finished" podID="fd500113-74d4-4784-89cd-b261e0c0cd3d" containerID="41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3" exitCode=0
Sep 19 01:43:33.658744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658666    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"
Sep 19 01:43:33.658744 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" event={"ID":"fd500113-74d4-4784-89cd-b261e0c0cd3d","Type":"ContainerDied","Data":"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"}
Sep 19 01:43:33.658858 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658753    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc" event={"ID":"fd500113-74d4-4784-89cd-b261e0c0cd3d","Type":"ContainerDied","Data":"8f909e42c253ae75a17acc656b1312bb34b260ff78fe743eea4a7df1b124e746"}
Sep 19 01:43:33.658858 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658775    2567 scope.go:117] "RemoveContainer" containerID="41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"
Sep 19 01:43:33.659011 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.658987    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" podUID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" containerName="payload-pre-processing" containerID="cri-o://f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489" gracePeriod=30
Sep 19 01:43:33.668265 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.668243    2567 scope.go:117] "RemoveContainer" containerID="41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"
Sep 19 01:43:33.668536 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:43:33.668519    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3\": container with ID starting with 41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3 not found: ID does not exist" containerID="41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"
Sep 19 01:43:33.668589 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.668545    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3"} err="failed to get container status \"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3\": rpc error: code = NotFound desc = could not find container \"41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3\": container with ID starting with 41795f69e279089cdd1563c6b7f7971fb83d87a27b46cc82546852bf61d439b3 not found: ID does not exist"
Sep 19 01:43:33.719766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.719747    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:43:33.721658 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.721635    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a4edd7-864767777f-gz2fc"]
Sep 19 01:43:33.748686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.748637    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fd500113-74d4-4784-89cd-b261e0c0cd3d-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:33.748686 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.748657    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd95w\" (UniqueName: \"kubernetes.io/projected/fd500113-74d4-4784-89cd-b261e0c0cd3d-kube-api-access-cd95w\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:33.821334 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.821282    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.886470 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.886448    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:43:33.913668 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.913632    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:33.950663 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.950639    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jttcr\" (UniqueName: \"kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr\") pod \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") "
Sep 19 01:43:33.950803 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.950767    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume\") pod \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\" (UID: \"a432097a-3371-4cb8-9e09-b0f11f43d8c0\") "
Sep 19 01:43:33.951135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.951113    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a432097a-3371-4cb8-9e09-b0f11f43d8c0" (UID: "a432097a-3371-4cb8-9e09-b0f11f43d8c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:43:33.952711 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:33.952689    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr" (OuterVolumeSpecName: "kube-api-access-jttcr") pod "a432097a-3371-4cb8-9e09-b0f11f43d8c0" (UID: "a432097a-3371-4cb8-9e09-b0f11f43d8c0"). InnerVolumeSpecName "kube-api-access-jttcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:43:34.052235 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.052208    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jttcr\" (UniqueName: \"kubernetes.io/projected/a432097a-3371-4cb8-9e09-b0f11f43d8c0-kube-api-access-jttcr\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:34.052235 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.052233    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a432097a-3371-4cb8-9e09-b0f11f43d8c0-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:43:34.638047 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.638011    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:34.664583 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.664553    2567 generic.go:356] "Generic (PLEG): container finished" podID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" containerID="f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489" exitCode=0
Sep 19 01:43:34.664763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.664617    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"
Sep 19 01:43:34.664763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.664640    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" event={"ID":"a432097a-3371-4cb8-9e09-b0f11f43d8c0","Type":"ContainerDied","Data":"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"}
Sep 19 01:43:34.664763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.664726    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s" event={"ID":"a432097a-3371-4cb8-9e09-b0f11f43d8c0","Type":"ContainerDied","Data":"a101b79cee6cbcc057e574108ec2970684fead8c1085b485fe5ca46312466afb"}
Sep 19 01:43:34.664763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.664757    2567 scope.go:117] "RemoveContainer" containerID="f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"
Sep 19 01:43:34.673765 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.673749    2567 scope.go:117] "RemoveContainer" containerID="f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"
Sep 19 01:43:34.674013 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:43:34.673993    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489\": container with ID starting with f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489 not found: ID does not exist" containerID="f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"
Sep 19 01:43:34.674093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.674019    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489"} err="failed to get container status \"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489\": rpc error: code = NotFound desc = could not find container \"f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489\": container with ID starting with f4320ddfda6269068c7275d658bf497e3c79a9af980e0c7c94f6cefa6814e489 not found: ID does not exist"
Sep 19 01:43:34.688958 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.688935    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:43:34.694138 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.694117    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a4edd7-57ffcd8f98-j8p4s"]
Sep 19 01:43:34.921395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.921315    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" path="/var/lib/kubelet/pods/a432097a-3371-4cb8-9e09-b0f11f43d8c0/volumes"
Sep 19 01:43:34.921687 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:34.921673    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd500113-74d4-4784-89cd-b261e0c0cd3d" path="/var/lib/kubelet/pods/fd500113-74d4-4784-89cd-b261e0c0cd3d/volumes"
Sep 19 01:43:35.307577 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:35.307553    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:35.961492 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:35.961440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:43:38.896548 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:43:38.896513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:00.174549 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:00.174513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:16.125639 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:16.125601    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:16.255262 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:16.255218    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:22.418355 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:22.418317    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:28.255624 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:28.255588    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:28.352721 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:28.352687    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:28.531083 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:28.531048    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:44:28.531392 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:28.531350    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy" containerID="cri-o://ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f" gracePeriod=30
Sep 19 01:44:28.558429 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:28.558405    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:29.117485 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:29.117459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:29.867364 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:29.867324    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:30.726510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:30.726478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:31.533766 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:31.533728    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:32.376395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:32.376367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:33.779881 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.779855    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:44:33.875802 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875745    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.875802 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875780    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2cm8\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875808    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875831    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875897    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876025 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.875998    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876032    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876054    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:33.876257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876130    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876159    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs\") pod \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\" (UID: \"001c9bf5-0486-4bf2-9e1d-62cf73959d77\") "
Sep 19 01:44:33.876257 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876157    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:33.876490 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876256    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data" (OuterVolumeSpecName: "istio-data") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:33.876490 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876276    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:44:33.876490 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:33.876629 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876609    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.876692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876634    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.876692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876647    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.876692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876660    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.876692 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.876673    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.877989 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.877967    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8" (OuterVolumeSpecName: "kube-api-access-f2cm8") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "kube-api-access-f2cm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:44:33.878214 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.878194    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:44:33.878363 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.878349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:33.878445 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.878422    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token" (OuterVolumeSpecName: "istio-token") pod "001c9bf5-0486-4bf2-9e1d-62cf73959d77" (UID: "001c9bf5-0486-4bf2-9e1d-62cf73959d77"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:44:33.955925 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.955898    2567 generic.go:356] "Generic (PLEG): container finished" podID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerID="ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f" exitCode=0
Sep 19 01:44:33.956037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.955960    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"
Sep 19 01:44:33.956037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.955969    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerDied","Data":"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"}
Sep 19 01:44:33.956037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.956006    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4" event={"ID":"001c9bf5-0486-4bf2-9e1d-62cf73959d77","Type":"ContainerDied","Data":"2b8914d62d169369de760491737eb7cbfc2978664795f22918433787ef2a304e"}
Sep 19 01:44:33.956037 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.956026    2567 scope.go:117] "RemoveContainer" containerID="ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"
Sep 19 01:44:33.964888 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.964874    2567 scope.go:117] "RemoveContainer" containerID="4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"
Sep 19 01:44:33.972560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.972540    2567 scope.go:117] "RemoveContainer" containerID="ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"
Sep 19 01:44:33.972813 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:44:33.972795    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f\": container with ID starting with ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f not found: ID does not exist" containerID="ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"
Sep 19 01:44:33.972862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.972820    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f"} err="failed to get container status \"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f\": rpc error: code = NotFound desc = could not find container \"ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f\": container with ID starting with ac77d67ebd2b32355f956d9dbd649892c762ff4103f5f3218a48445cdd2e5e0f not found: ID does not exist"
Sep 19 01:44:33.972862 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.972835    2567 scope.go:117] "RemoveContainer" containerID="4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"
Sep 19 01:44:33.973093 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:44:33.973075    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac\": container with ID starting with 4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac not found: ID does not exist" containerID="4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"
Sep 19 01:44:33.973135 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.973098    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac"} err="failed to get container status \"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac\": rpc error: code = NotFound desc = could not find container \"4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac\": container with ID starting with 4e7e4a3e06f9836e651e9d8d266e87f156663362f1efebb1d938d9bfa48ceeac not found: ID does not exist"
Sep 19 01:44:33.977699 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.977676    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2cm8\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-kube-api-access-f2cm8\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.977808 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.977702    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.977808 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.977716    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.977808 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.977728    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/001c9bf5-0486-4bf2-9e1d-62cf73959d77-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:33.978844 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.978826    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:44:33.984251 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:33.984231    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a4edd7-openshift-default-6575b56c84-mn5s4"]
Sep 19 01:44:34.921805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:34.921772    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" path="/var/lib/kubelet/pods/001c9bf5-0486-4bf2-9e1d-62cf73959d77/volumes"
Sep 19 01:44:39.572879 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.572841    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:44:39.573289 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.573127    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" podUID="a9e434f9-09cf-4037-8bc7-095968301bab" containerName="payload-processing" containerID="cri-o://f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc" gracePeriod=30
Sep 19 01:44:39.577200 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.577114    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:39.660964 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.660908    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:39.760215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.760127    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:39.826231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.826174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:44:39.853041 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.852987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:39.930287 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.930253    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume\") pod \"a9e434f9-09cf-4037-8bc7-095968301bab\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") "
Sep 19 01:44:39.930474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.930415    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f86ng\" (UniqueName: \"kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng\") pod \"a9e434f9-09cf-4037-8bc7-095968301bab\" (UID: \"a9e434f9-09cf-4037-8bc7-095968301bab\") "
Sep 19 01:44:39.930738 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.930700    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9e434f9-09cf-4037-8bc7-095968301bab" (UID: "a9e434f9-09cf-4037-8bc7-095968301bab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:44:39.933093 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.933065    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng" (OuterVolumeSpecName: "kube-api-access-f86ng") pod "a9e434f9-09cf-4037-8bc7-095968301bab" (UID: "a9e434f9-09cf-4037-8bc7-095968301bab"). InnerVolumeSpecName "kube-api-access-f86ng". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:44:39.985465 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.985431    2567 generic.go:356] "Generic (PLEG): container finished" podID="a9e434f9-09cf-4037-8bc7-095968301bab" containerID="f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc" exitCode=0
Sep 19 01:44:39.985594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.985483    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"
Sep 19 01:44:39.985594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.985522    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" event={"ID":"a9e434f9-09cf-4037-8bc7-095968301bab","Type":"ContainerDied","Data":"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"}
Sep 19 01:44:39.985594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.985577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh" event={"ID":"a9e434f9-09cf-4037-8bc7-095968301bab","Type":"ContainerDied","Data":"ad017f59c3e2fac67bf5cd312dcaa6f1fd001a05be80f0ebb51fb4b86960dfbb"}
Sep 19 01:44:39.985716 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.985599    2567 scope.go:117] "RemoveContainer" containerID="f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"
Sep 19 01:44:39.994304 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.994281    2567 scope.go:117] "RemoveContainer" containerID="f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"
Sep 19 01:44:39.994557 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:44:39.994537    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc\": container with ID starting with f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc not found: ID does not exist" containerID="f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"
Sep 19 01:44:39.994623 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:39.994569    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc"} err="failed to get container status \"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc\": rpc error: code = NotFound desc = could not find container \"f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc\": container with ID starting with f1f458d2ca325520f06f042e59e4246293bb8f54ddab90b8af14497a7212e1cc not found: ID does not exist"
Sep 19 01:44:40.009353 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.009330    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:44:40.013575 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.013546    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-14de36-6d6dc978d5-k9dkh"]
Sep 19 01:44:40.031375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.031353    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f86ng\" (UniqueName: \"kubernetes.io/projected/a9e434f9-09cf-4037-8bc7-095968301bab-kube-api-access-f86ng\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:40.031375 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.031371    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9e434f9-09cf-4037-8bc7-095968301bab-plugins-config-volume\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:40.163325 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.163250    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:40.229459 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.229428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:40.920671 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.920634    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9e434f9-09cf-4037-8bc7-095968301bab" path="/var/lib/kubelet/pods/a9e434f9-09cf-4037-8bc7-095968301bab/volumes"
Sep 19 01:44:40.961979 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:40.961943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:41.844867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:41.844813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:41.955729 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:41.955692    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:42.054753 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:42.054726    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:46.311097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:46.311057    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:46.411762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:46.411723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:46.565631 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:46.565551    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:44:46.565768 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:46.565750    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy" containerID="cri-o://40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e" gracePeriod=30
Sep 19 01:44:46.588365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:46.588333    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:47.093017 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:47.092987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:47.929115 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:47.929065    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:48.788113 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:48.788077    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:49.514778 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:49.514739    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:51.817959 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.817935    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:44:51.950749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950676    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.950749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950711    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl2bc\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.950749 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950734    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950781    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950813    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950846    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950888    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950933    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert\") pod \"f5704979-2e85-4892-8f71-1582be58ca13\" (UID: \"f5704979-2e85-4892-8f71-1582be58ca13\") "
Sep 19 01:44:51.951009 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.950966    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:51.951402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.951213    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:51.951402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.951253    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:51.951402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.951272    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:51.951402 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.951330    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data" (OuterVolumeSpecName: "istio-data") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:51.951620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.951539    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:44:51.953066 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.953043    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:44:51.953066 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.953046    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:44:51.953336 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.953308    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token" (OuterVolumeSpecName: "istio-token") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:44:51.953421 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:51.953391    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc" (OuterVolumeSpecName: "kube-api-access-xl2bc") pod "f5704979-2e85-4892-8f71-1582be58ca13" (UID: "f5704979-2e85-4892-8f71-1582be58ca13"). InnerVolumeSpecName "kube-api-access-xl2bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:44:52.043014 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.042983    2567 generic.go:356] "Generic (PLEG): container finished" podID="f5704979-2e85-4892-8f71-1582be58ca13" containerID="40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e" exitCode=0
Sep 19 01:44:52.043160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.043031    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"
Sep 19 01:44:52.043160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.043073    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerDied","Data":"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"}
Sep 19 01:44:52.043160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.043128    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk" event={"ID":"f5704979-2e85-4892-8f71-1582be58ca13","Type":"ContainerDied","Data":"eaa282ccf3196465113478dfe6f8605fb6f464ad8e8c2aa888adb7bbdab0214b"}
Sep 19 01:44:52.043160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.043150    2567 scope.go:117] "RemoveContainer" containerID="40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"
Sep 19 01:44:52.051866 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051845    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051872    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051886    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051899    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f5704979-2e85-4892-8f71-1582be58ca13-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051931    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl2bc\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-kube-api-access-xl2bc\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051944    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f5704979-2e85-4892-8f71-1582be58ca13-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051956    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f5704979-2e85-4892-8f71-1582be58ca13-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.051986 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.051967    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f5704979-2e85-4892-8f71-1582be58ca13-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:44:52.052781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.052768    2567 scope.go:117] "RemoveContainer" containerID="6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"
Sep 19 01:44:52.060511 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.060493    2567 scope.go:117] "RemoveContainer" containerID="40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"
Sep 19 01:44:52.060787 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:44:52.060769    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e\": container with ID starting with 40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e not found: ID does not exist" containerID="40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"
Sep 19 01:44:52.060833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.060795    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e"} err="failed to get container status \"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e\": rpc error: code = NotFound desc = could not find container \"40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e\": container with ID starting with 40c1839cdde581bce84144fe9790c478112a3353dd1a18406dfcdf98736bfd1e not found: ID does not exist"
Sep 19 01:44:52.060833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.060813    2567 scope.go:117] "RemoveContainer" containerID="6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"
Sep 19 01:44:52.061075 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:44:52.061061    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0\": container with ID starting with 6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0 not found: ID does not exist" containerID="6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"
Sep 19 01:44:52.061128 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.061080    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0"} err="failed to get container status \"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0\": rpc error: code = NotFound desc = could not find container \"6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0\": container with ID starting with 6733ab5bf7a7151804b2591c6382a12dced9f91bd0c5bcaee51a3de618e3bda0 not found: ID does not exist"
Sep 19 01:44:52.069229 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.069203    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:44:52.076054 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.076034    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-14de36-openshift-default-f54c94d4b-2nfhk"]
Sep 19 01:44:52.921294 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:52.921260    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5704979-2e85-4892-8f71-1582be58ca13" path="/var/lib/kubelet/pods/f5704979-2e85-4892-8f71-1582be58ca13/volumes"
Sep 19 01:44:57.540401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:57.540367    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:57.700794 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:57.700761    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:57.802280 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:57.802196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:57.875704 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:57.875672    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:58.254649 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:58.254544    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:58.325403 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:58.325353    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:44:59.203558 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:44:59.203510    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:00.148885 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.148854    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"]
Sep 19 01:45:00.149238 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149226    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149240    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149252    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149258    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149264    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149270    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149276    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149282    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149291    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2262a7ff-fba7-4768-b162-5670a232a3f3" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149297    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2262a7ff-fba7-4768-b162-5670a232a3f3" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149307    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9e434f9-09cf-4037-8bc7-095968301bab" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149312    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9e434f9-09cf-4037-8bc7-095968301bab" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149321    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" containerName="payload-pre-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149327    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" containerName="payload-pre-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149339    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd500113-74d4-4784-89cd-b261e0c0cd3d" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149344    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd500113-74d4-4784-89cd-b261e0c0cd3d" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149396    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd500113-74d4-4784-89cd-b261e0c0cd3d" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149402    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2262a7ff-fba7-4768-b162-5670a232a3f3" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149410    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149415    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149421    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149428    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149434    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149440    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1069804f-cbdf-4498-b174-5cca8261dc03" containerName="istio-proxy"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149446    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9e434f9-09cf-4037-8bc7-095968301bab" containerName="payload-processing"
Sep 19 01:45:00.149501 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.149453    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a432097a-3371-4cb8-9e09-b0f11f43d8c0" containerName="payload-pre-processing"
Sep 19 01:45:00.152030 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.152015    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"
Sep 19 01:45:00.155132 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.155112    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s7pvt\""
Sep 19 01:45:00.161654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.161634    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"
Sep 19 01:45:00.163303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.163281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"]
Sep 19 01:45:00.452109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:00.452080    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"]
Sep 19 01:45:00.452704 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:45:00.452670    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2c2b00_750c_48e3_85a5_a4f7172a5862.slice/crio-8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1 WatchSource:0}: Error finding container 8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1: Status 404 returned error can't find the container with id 8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1
Sep 19 01:45:01.088444 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:01.088410    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h" event={"ID":"dc2c2b00-750c-48e3-85a5-a4f7172a5862","Type":"ContainerStarted","Data":"4f292a679c4b40939e676fb4e369725182617be6c85b23b50ffde0873cae92eb"}
Sep 19 01:45:01.088615 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:01.088461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h" event={"ID":"dc2c2b00-750c-48e3-85a5-a4f7172a5862","Type":"ContainerStarted","Data":"8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1"}
Sep 19 01:45:01.115566 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:01.115521    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h" podStartSLOduration=1.11550726 podStartE2EDuration="1.11550726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:45:01.112268488 +0000 UTC m=+1948.453716412" watchObservedRunningTime="2026-09-19 01:45:01.11550726 +0000 UTC m=+1948.456955162"
Sep 19 01:45:02.095611 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:02.095572    2567 generic.go:356] "Generic (PLEG): container finished" podID="dc2c2b00-750c-48e3-85a5-a4f7172a5862" containerID="4f292a679c4b40939e676fb4e369725182617be6c85b23b50ffde0873cae92eb" exitCode=0
Sep 19 01:45:02.095982 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:02.095658    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h" event={"ID":"dc2c2b00-750c-48e3-85a5-a4f7172a5862","Type":"ContainerDied","Data":"4f292a679c4b40939e676fb4e369725182617be6c85b23b50ffde0873cae92eb"}
Sep 19 01:45:02.896203 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:02.896170    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:03.228378 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:03.228355    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"
Sep 19 01:45:04.105982 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:04.105952    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"
Sep 19 01:45:04.106140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:04.105953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h" event={"ID":"dc2c2b00-750c-48e3-85a5-a4f7172a5862","Type":"ContainerDied","Data":"8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1"}
Sep 19 01:45:04.106140 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:04.106053    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8790f2cd0e51810e8cedc7c648d3a9be2495f2cd844ef9094f3767b4bbf37dd1"
Sep 19 01:45:05.700371 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:05.700336    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:05.803335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:05.803297    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:06.023763 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:06.023669    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:06.800056 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:06.800018    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:07.991347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:07.991309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:09.137594 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:09.137552    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:16.849835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:16.849749    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:16.850349 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:16.850325    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"]
Sep 19 01:45:16.856737 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:16.856709    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-bebef4-29829705-thp8h"]
Sep 19 01:45:16.921790 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:16.921755    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc2c2b00-750c-48e3-85a5-a4f7172a5862" path="/var/lib/kubelet/pods/dc2c2b00-750c-48e3-85a5-a4f7172a5862/volumes"
Sep 19 01:45:16.926307 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:16.926283    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:17.031655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:17.031628    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:17.146544 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:17.146458    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:17.439021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:17.438938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:17.541655 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:17.541616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:24.691191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:24.691151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:24.780071 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:24.780030    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:24.977209 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:24.977132    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:45:24.977374 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:24.977338    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy" containerID="cri-o://5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3" gracePeriod=30
Sep 19 01:45:25.026688 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:25.026646    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:45:30.234265 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.234232    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:45:30.234952 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.234909    2567 generic.go:356] "Generic (PLEG): container finished" podID="d6827455-e067-4715-b857-d1f28e6d28fa" containerID="5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3" exitCode=0
Sep 19 01:45:30.235087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.234960    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerDied","Data":"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"}
Sep 19 01:45:30.235087 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.235058    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9" event={"ID":"d6827455-e067-4715-b857-d1f28e6d28fa","Type":"ContainerDied","Data":"078788b67473e5f94b05d5276070853a5bc92c78757287f3aea8dc7fd36bbdd9"}
Sep 19 01:45:30.235227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.235090    2567 scope.go:117] "RemoveContainer" containerID="5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"
Sep 19 01:45:30.244454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.244432    2567 scope.go:117] "RemoveContainer" containerID="19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"
Sep 19 01:45:30.255877 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.254810    2567 scope.go:117] "RemoveContainer" containerID="5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"
Sep 19 01:45:30.256620 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:45:30.256427    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3\": container with ID starting with 5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3 not found: ID does not exist" containerID="5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"
Sep 19 01:45:30.256620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.256463    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3"} err="failed to get container status \"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3\": rpc error: code = NotFound desc = could not find container \"5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3\": container with ID starting with 5a053cab82fceb75bd8652e869250e0200f8b756156b78f290657825716ed9c3 not found: ID does not exist"
Sep 19 01:45:30.256620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.256486    2567 scope.go:117] "RemoveContainer" containerID="19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"
Sep 19 01:45:30.256835 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:45:30.256764    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d\": container with ID starting with 19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d not found: ID does not exist" containerID="19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"
Sep 19 01:45:30.256835 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.256795    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d"} err="failed to get container status \"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d\": rpc error: code = NotFound desc = could not find container \"19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d\": container with ID starting with 19ec22dc758f3008e3abc928f205c0a88a437a2446fee477e89c7d47257b995d not found: ID does not exist"
Sep 19 01:45:30.402191 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402161    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402225    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402258    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402287    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402365 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402329    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402420    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402512    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402573 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402537    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl7mr\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr\") pod \"d6827455-e067-4715-b857-d1f28e6d28fa\" (UID: \"d6827455-e067-4715-b857-d1f28e6d28fa\") "
Sep 19 01:45:30.402762 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402568    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:45:30.402854 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.402832    2567 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.403131 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.403104    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:45:30.403662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.403288    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:45:30.403662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.403468    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:45:30.403662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.403609    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:45:30.405088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.405049    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 01:45:30.406381 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.406337    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr" (OuterVolumeSpecName: "kube-api-access-xl7mr") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "kube-api-access-xl7mr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:45:30.406381 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.406349    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 01:45:30.406788 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.406758    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "d6827455-e067-4715-b857-d1f28e6d28fa" (UID: "d6827455-e067-4715-b857-d1f28e6d28fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503400    2567 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-workload-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503432    2567 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6827455-e067-4715-b857-d1f28e6d28fa-istio-podinfo\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503441    2567 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6827455-e067-4715-b857-d1f28e6d28fa-istiod-ca-cert\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503448    2567 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-data\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503456    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl7mr\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-kube-api-access-xl7mr\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503465    2567 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-istio-envoy\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503473    2567 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6827455-e067-4715-b857-d1f28e6d28fa-istio-token\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:30.503475 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:30.503480    2567 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6827455-e067-4715-b857-d1f28e6d28fa-credential-socket\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:45:31.240949 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:31.240857    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"
Sep 19 01:45:31.259848 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:31.259822    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:45:31.265555 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:31.265532    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-bebef4-openshift-default-69dc8db4bb-9pck9"]
Sep 19 01:45:32.920882 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:45:32.920851    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" path="/var/lib/kubelet/pods/d6827455-e067-4715-b857-d1f28e6d28fa/volumes"
Sep 19 01:46:53.499652 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:46:53.499613    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:46:54.945810 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:46:54.945777    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:47:35.072120 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:47:35.072092    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:47:35.076154 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:47:35.076132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zmst2_5911355c-4a74-44c6-a895-24e17ee6e7b5/ovn-acl-logging/0.log"
Sep 19 01:47:43.029510 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:47:43.029462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:47:43.142180 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:47:43.142146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:47:43.236403 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:47:43.236166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:48:09.558579 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:48:09.558545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:48:18.082356 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:48:18.082262    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:48:18.164169 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:48:18.164137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:48:43.453092 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:48:43.453053    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:50:10.971870 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:50:10.971835    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:50:21.135335 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:50:21.135299    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:50:39.793006 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:50:39.792963    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:50:41.547252 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:50:41.547220    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:51:00.631812 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.631780    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"]
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632135    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632147    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="001c9bf5-0486-4bf2-9e1d-62cf73959d77" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632159    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632165    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5704979-2e85-4892-8f71-1582be58ca13" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632174    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632180    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632185    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632190    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632204    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc2c2b00-750c-48e3-85a5-a4f7172a5862" containerName="cleanup"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632209    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc2c2b00-750c-48e3-85a5-a4f7172a5862" containerName="cleanup"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632262    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632272    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6827455-e067-4715-b857-d1f28e6d28fa" containerName="istio-proxy"
Sep 19 01:51:00.632286 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.632279    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc2c2b00-750c-48e3-85a5-a4f7172a5862" containerName="cleanup"
Sep 19 01:51:00.635514 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.635497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.644971 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.644948    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"]
Sep 19 01:51:00.683837 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.683811    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-maas-api-tls\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.683985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.683871    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30aa1322-9ba9-4d36-900d-b98b0655c0a8-openshift-service-ca\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.683985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.683890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-metrics-certs\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.683985 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.683956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dc58\" (UniqueName: \"kubernetes.io/projected/30aa1322-9ba9-4d36-900d-b98b0655c0a8-kube-api-access-7dc58\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.784697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.784665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30aa1322-9ba9-4d36-900d-b98b0655c0a8-openshift-service-ca\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.784697 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.784701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-metrics-certs\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.784938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.784745    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dc58\" (UniqueName: \"kubernetes.io/projected/30aa1322-9ba9-4d36-900d-b98b0655c0a8-kube-api-access-7dc58\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.784938 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.784772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-maas-api-tls\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.785406 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.785382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/30aa1322-9ba9-4d36-900d-b98b0655c0a8-openshift-service-ca\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.787227 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.787204    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-maas-api-tls\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.787315 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.787255    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/30aa1322-9ba9-4d36-900d-b98b0655c0a8-metrics-certs\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.793021 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.793001    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dc58\" (UniqueName: \"kubernetes.io/projected/30aa1322-9ba9-4d36-900d-b98b0655c0a8-kube-api-access-7dc58\") pod \"maas-api-68c86dfd56-6jmd4\" (UID: \"30aa1322-9ba9-4d36-900d-b98b0655c0a8\") " pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:00.946932 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:00.946839    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:01.234347 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.234196    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"]
Sep 19 01:51:01.238102 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:51:01.238069    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30aa1322_9ba9_4d36_900d_b98b0655c0a8.slice/crio-0f515226ba693e03204e22688b2c240df6e49c386474317ccc8560c0744889b1 WatchSource:0}: Error finding container 0f515226ba693e03204e22688b2c240df6e49c386474317ccc8560c0744889b1: Status 404 returned error can't find the container with id 0f515226ba693e03204e22688b2c240df6e49c386474317ccc8560c0744889b1
Sep 19 01:51:01.240160 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.240135    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 01:51:01.787014 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.786978    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4" event={"ID":"30aa1322-9ba9-4d36-900d-b98b0655c0a8","Type":"ContainerStarted","Data":"e0477edf63f26233d9e8ea7775eae78026686f70eb35958a2a12fd8c35f560e5"}
Sep 19 01:51:01.787395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.787044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4" event={"ID":"30aa1322-9ba9-4d36-900d-b98b0655c0a8","Type":"ContainerStarted","Data":"0f515226ba693e03204e22688b2c240df6e49c386474317ccc8560c0744889b1"}
Sep 19 01:51:01.787395 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.787194    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:01.807454 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:01.807410    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4" podStartSLOduration=1.415967548 podStartE2EDuration="1.807395901s" totalImagesPullingTime="391.428353ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 01:51:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:51:01.805356856 +0000 UTC m=+2309.146804782" watchObservedRunningTime="2026-09-19 01:51:01.807395901 +0000 UTC m=+2309.148843823"
Sep 19 01:51:07.796852 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:07.796827    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68c86dfd56-6jmd4"
Sep 19 01:51:15.857247 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:15.857214    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:51:15.857646 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:15.857391    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerName="maas-api" containerID="cri-o://7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e" gracePeriod=30
Sep 19 01:51:16.439585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:16.439548    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.32:8443/health\": dial tcp 10.134.0.32:8443: connect: connection refused"
Sep 19 01:51:17.097608 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.097586    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:51:17.225339 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.225280    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca\") pod \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") "
Sep 19 01:51:17.225460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.225357    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls\") pod \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") "
Sep 19 01:51:17.225460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.225386    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs\") pod \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") "
Sep 19 01:51:17.225460 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.225422    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q\") pod \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\" (UID: \"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5\") "
Sep 19 01:51:17.225681 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.225657    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" (UID: "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 01:51:17.227507 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.227476    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" (UID: "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:51:17.227620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.227518    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" (UID: "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 01:51:17.227620 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.227561    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q" (OuterVolumeSpecName: "kube-api-access-flp9q") pod "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" (UID: "912ff3dc-2fb6-4ed1-ad50-dd2315325ca5"). InnerVolumeSpecName "kube-api-access-flp9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 01:51:17.326781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.326756    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-maas-api-tls\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:51:17.326781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.326776    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-metrics-certs\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:51:17.326781 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.326785    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flp9q\" (UniqueName: \"kubernetes.io/projected/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-kube-api-access-flp9q\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:51:17.326988 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.326793    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5-openshift-service-ca\") on node \"ip-10-0-143-9.ec2.internal\" DevicePath \"\""
Sep 19 01:51:17.868638 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.868604    2567 generic.go:356] "Generic (PLEG): container finished" podID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerID="7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e" exitCode=0
Sep 19 01:51:17.868805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.868659    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"
Sep 19 01:51:17.868805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.868694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" event={"ID":"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5","Type":"ContainerDied","Data":"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"}
Sep 19 01:51:17.868805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.868767    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz" event={"ID":"912ff3dc-2fb6-4ed1-ad50-dd2315325ca5","Type":"ContainerDied","Data":"10b95258f18f0c11b02da1711f452fe3017740ce3553cfa5a22d639d1ec9fe76"}
Sep 19 01:51:17.868805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.868789    2567 scope.go:117] "RemoveContainer" containerID="7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"
Sep 19 01:51:17.877698 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.877683    2567 scope.go:117] "RemoveContainer" containerID="7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"
Sep 19 01:51:17.877978 ip-10-0-143-9 kubenswrapper[2567]: E0919 01:51:17.877959    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e\": container with ID starting with 7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e not found: ID does not exist" containerID="7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"
Sep 19 01:51:17.878049 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.877985    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e"} err="failed to get container status \"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e\": rpc error: code = NotFound desc = could not find container \"7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e\": container with ID starting with 7bd1d2a0e62b6c36f6d5c4ef6f03af04d6b392ec2721c5c40a56d2da127b871e not found: ID does not exist"
Sep 19 01:51:17.892818 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.892795    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:51:17.898379 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:17.898359    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5598d8c9fb-mrfcz"]
Sep 19 01:51:18.920912 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:18.920879    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" path="/var/lib/kubelet/pods/912ff3dc-2fb6-4ed1-ad50-dd2315325ca5/volumes"
Sep 19 01:51:35.338012 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:35.337981    2567 scope.go:117] "RemoveContainer" containerID="4f292a679c4b40939e676fb4e369725182617be6c85b23b50ffde0873cae92eb"
Sep 19 01:51:41.861999 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:41.861961    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6m7sn_97b74574-876b-4bc6-8d69-fc90ac46d057/manager/0.log"
Sep 19 01:51:42.246215 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:42.246128    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748475db69-f4cnd_c31d24a9-403a-47d3-8096-a46efd95cde0/copy-manifests/0.log"
Sep 19 01:51:42.264654 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:42.264621    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748475db69-f4cnd_c31d24a9-403a-47d3-8096-a46efd95cde0/manager/0.log"
Sep 19 01:51:42.629662 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:42.629627    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-68c86dfd56-6jmd4_30aa1322-9ba9-4d36-900d-b98b0655c0a8/maas-api/0.log"
Sep 19 01:51:45.015344 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:45.015311    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5_c7c0f69e-677c-4d39-8d3f-c2df629daf7e/istio-proxy/0.log"
Sep 19 01:51:45.135926 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:45.135894    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fsb7x_87bf380d-518d-4298-aef5-e5b7c2b13b2d/discovery/0.log"
Sep 19 01:51:45.489637 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:45.489604    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/1.log"
Sep 19 01:51:46.222327 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:46.222298    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-74dgg_19bcba77-e2ec-454b-a0d3-c375c5a7dc0e/main/0.log"
Sep 19 01:51:46.445092 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:46.445069    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-jk8pf_fd4e8b20-da36-4d5a-83cb-4bc11024aece/main/0.log"
Sep 19 01:51:46.670756 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:46.670722    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f755k5_11cd11e0-5bdb-4bb4-a8c8-34e7726d5923/main/0.log"
Sep 19 01:51:52.779254 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:52.779208    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:51:52.880603 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:52.880567    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:51:55.812231 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:55.812198    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-p58b7_0c9a1446-5387-4dcc-8ffd-61865b20b704/global-pull-secret-syncer/0.log"
Sep 19 01:51:55.872833 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:55.872805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log"
Sep 19 01:51:56.020709 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:51:56.020684    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-9.ec2.internal_f301cdf4e0c29dc70eeb444d9a4d1da3/haproxy/0.log"
Sep 19 01:52:02.840170 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:02.840143    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/alertmanager/0.log"
Sep 19 01:52:02.897982 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:02.897955    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/config-reloader/0.log"
Sep 19 01:52:02.996564 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:02.996532    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/kube-rbac-proxy-web/0.log"
Sep 19 01:52:03.105219 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.105152    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/kube-rbac-proxy/0.log"
Sep 19 01:52:03.143391 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.143362    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/kube-rbac-proxy-metric/0.log"
Sep 19 01:52:03.176751 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.176724    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/prom-label-proxy/0.log"
Sep 19 01:52:03.212824 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.212805    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3cdb90c5-8737-4818-a24e-8b1ebe63a74e/init-config-reloader/0.log"
Sep 19 01:52:03.613832 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.613800    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mw7c7_10b62535-3b55-45db-85a8-0d6c275f909f/node-exporter/0.log"
Sep 19 01:52:03.633457 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.633438    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mw7c7_10b62535-3b55-45db-85a8-0d6c275f909f/kube-rbac-proxy/0.log"
Sep 19 01:52:03.657451 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.657434    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mw7c7_10b62535-3b55-45db-85a8-0d6c275f909f/init-textfile/0.log"
Sep 19 01:52:03.789387 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.789354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/prometheus/0.log"
Sep 19 01:52:03.809324 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.809302    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/config-reloader/0.log"
Sep 19 01:52:03.829370 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.829354    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/thanos-sidecar/0.log"
Sep 19 01:52:03.853902 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.853878    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/kube-rbac-proxy-web/0.log"
Sep 19 01:52:03.874097 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.874046    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/kube-rbac-proxy/0.log"
Sep 19 01:52:03.895560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.895541    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/kube-rbac-proxy-thanos/0.log"
Sep 19 01:52:03.918088 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:03.918070    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79ff507e-e262-4655-9bf6-f325bec7306e/init-config-reloader/0.log"
Sep 19 01:52:04.020793 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:04.020771    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-8kbmm_dc22f166-c301-4a08-ace8-5d7e0a173d7d/prometheus-operator-admission-webhook/0.log"
Sep 19 01:52:04.050253 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:04.050229    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857d5fd69-cgpnq_a467b25c-0417-4448-867e-608ea0ffeb92/telemeter-client/0.log"
Sep 19 01:52:04.075578 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:04.075560    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857d5fd69-cgpnq_a467b25c-0417-4448-867e-608ea0ffeb92/reload/0.log"
Sep 19 01:52:04.099561 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:04.099540    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-857d5fd69-cgpnq_a467b25c-0417-4448-867e-608ea0ffeb92/kube-rbac-proxy/0.log"
Sep 19 01:52:05.463732 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.463701    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-59vn6_cc9f15ae-63d7-48ee-ba3a-16f63932fa99/networking-console-plugin/0.log"
Sep 19 01:52:05.749114 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.749039    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"]
Sep 19 01:52:05.749401 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.749390    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerName="maas-api"
Sep 19 01:52:05.749448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.749402    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerName="maas-api"
Sep 19 01:52:05.749483 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.749462    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="912ff3dc-2fb6-4ed1-ad50-dd2315325ca5" containerName="maas-api"
Sep 19 01:52:05.752574 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.752547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.755426 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.755397    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vc5k7\"/\"openshift-service-ca.crt\""
Sep 19 01:52:05.756560 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.756539    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vc5k7\"/\"kube-root-ca.crt\""
Sep 19 01:52:05.756672 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.756617    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vc5k7\"/\"default-dockercfg-gbbnr\""
Sep 19 01:52:05.761232 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.761212    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"]
Sep 19 01:52:05.822477 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.822456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcn8s\" (UniqueName: \"kubernetes.io/projected/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-kube-api-access-gcn8s\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.822585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.822495    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-lib-modules\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.822585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.822562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-sys\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.822585 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.822582    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-podres\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.822694 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.822598    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-proc\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.923888 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.923860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-sys\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.923991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.923895    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-podres\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.923991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.923933    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-proc\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.923991 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.923945    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-sys\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.924109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.923990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcn8s\" (UniqueName: \"kubernetes.io/projected/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-kube-api-access-gcn8s\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.924109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.924000    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-proc\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.924109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.924020    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-podres\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.924109 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.924038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-lib-modules\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.924236 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.924159    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-lib-modules\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:05.932997 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:05.932975    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcn8s\" (UniqueName: \"kubernetes.io/projected/55bcb2d6-a564-4b56-8811-e7cfe4c87dcc-kube-api-access-gcn8s\") pod \"perf-node-gather-daemonset-cgm7b\" (UID: \"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc\") " pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:06.063872 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:06.063851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:06.335758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:06.335729    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"]
Sep 19 01:52:06.337749 ip-10-0-143-9 kubenswrapper[2567]: W0919 01:52:06.337722    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod55bcb2d6_a564_4b56_8811_e7cfe4c87dcc.slice/crio-9853045b073f4ebff54a03663fd328ba70145a78f439df377418051b7fcb1d21 WatchSource:0}: Error finding container 9853045b073f4ebff54a03663fd328ba70145a78f439df377418051b7fcb1d21: Status 404 returned error can't find the container with id 9853045b073f4ebff54a03663fd328ba70145a78f439df377418051b7fcb1d21
Sep 19 01:52:06.747448 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:06.747372    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6594f4c75-tbqb8_4b052f94-972d-4848-ac7f-499dec0d58d3/download-server/0.log"
Sep 19 01:52:07.098591 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:07.098559    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b" event={"ID":"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc","Type":"ContainerStarted","Data":"6db06269597c33646098170ad33d8e84296463d8efc422e59a100bda68a1ed2b"}
Sep 19 01:52:07.098758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:07.098606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b" event={"ID":"55bcb2d6-a564-4b56-8811-e7cfe4c87dcc","Type":"ContainerStarted","Data":"9853045b073f4ebff54a03663fd328ba70145a78f439df377418051b7fcb1d21"}
Sep 19 01:52:07.098758 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:07.098626    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:07.118170 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:07.118129    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b" podStartSLOduration=2.118114788 podStartE2EDuration="2.118114788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 01:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 01:52:07.118063641 +0000 UTC m=+2374.459511565" watchObservedRunningTime="2026-09-19 01:52:07.118114788 +0000 UTC m=+2374.459562711"
Sep 19 01:52:08.572960 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:08.572927    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wj866_a25efb0c-3626-4adf-aa67-386fc1ad148d/dns/0.log"
Sep 19 01:52:08.592205 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:08.592178    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wj866_a25efb0c-3626-4adf-aa67-386fc1ad148d/kube-rbac-proxy/0.log"
Sep 19 01:52:08.616028 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:08.616002    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4rrbn_b867204f-1ec7-4775-b034-0e1e9cb5d7cd/dns-node-resolver/0.log"
Sep 19 01:52:09.180427 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:09.180398    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69d5c4cdcd-wrgt9_cfb0d07c-0f84-4bfe-9ef0-6c7219974538/registry/0.log"
Sep 19 01:52:09.203567 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:09.203545    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2q64x_e98f12d3-21a6-4761-9bd4-31fe87a862e8/node-ca/0.log"
Sep 19 01:52:10.420474 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:10.420443    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5_c7c0f69e-677c-4d39-8d3f-c2df629daf7e/istio-proxy/0.log"
Sep 19 01:52:11.173792 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:11.173766    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fsb7x_87bf380d-518d-4298-aef5-e5b7c2b13b2d/discovery/0.log"
Sep 19 01:52:11.243934 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:11.243873    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/0.log"
Sep 19 01:52:11.248852 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:11.248827    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/1.log"
Sep 19 01:52:12.271710 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:12.271676    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2j7fz_98c1ff6e-a7b0-4487-a59a-8b1905ddca1a/serve-healthcheck-canary/0.log"
Sep 19 01:52:12.860321 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:12.860292    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4tfrj_f02824a2-1799-447d-bd98-d4eff0752e0a/kube-rbac-proxy/0.log"
Sep 19 01:52:12.884805 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:12.884779    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4tfrj_f02824a2-1799-447d-bd98-d4eff0752e0a/exporter/0.log"
Sep 19 01:52:12.905613 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:12.905594    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4tfrj_f02824a2-1799-447d-bd98-d4eff0752e0a/extractor/0.log"
Sep 19 01:52:13.113497 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:13.113444    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vc5k7/perf-node-gather-daemonset-cgm7b"
Sep 19 01:52:16.097014 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.096983    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5_c7c0f69e-677c-4d39-8d3f-c2df629daf7e/istio-proxy/0.log"
Sep 19 01:52:16.268022 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.267992    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-6m7sn_97b74574-876b-4bc6-8d69-fc90ac46d057/manager/0.log"
Sep 19 01:52:16.555274 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.555243    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748475db69-f4cnd_c31d24a9-403a-47d3-8096-a46efd95cde0/manager/0.log"
Sep 19 01:52:16.577867 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.577839    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748475db69-f4cnd_c31d24a9-403a-47d3-8096-a46efd95cde0/copy-manifests/0.log"
Sep 19 01:52:16.924303 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.924272    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fsb7x_87bf380d-518d-4298-aef5-e5b7c2b13b2d/discovery/0.log"
Sep 19 01:52:16.979852 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.979825    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/0.log"
Sep 19 01:52:16.984742 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:16.984721    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/1.log"
Sep 19 01:52:17.908495 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:17.908468    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-74c67d8b6f-cqhmx_99f5bfac-5429-464e-8346-72d2e9db0b37/manager/0.log"
Sep 19 01:52:18.477285 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:18.477252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6rcls_c48076c9-eb3e-4732-8270-ee9708243caf/konnectivity-agent/0.log" limit=1024
Sep 19 01:52:18.670845 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:18.670821    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hchx5_c7c0f69e-677c-4d39-8d3f-c2df629daf7e/istio-proxy/0.log"
Sep 19 01:52:19.448605 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:19.448573    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fsb7x_87bf380d-518d-4298-aef5-e5b7c2b13b2d/discovery/0.log"
Sep 19 01:52:19.506244 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:19.506209    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/0.log"
Sep 19 01:52:19.512258 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:19.512237    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-ks4rw_69871c7e-95b6-4a18-8d3e-2c3b5dc47cc8/istio-proxy/1.log"
Sep 19 01:52:23.009580 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:23.009550    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k7jjx_68648148-0ad9-4533-86db-1061062b22ba/migrator/0.log"
Sep 19 01:52:23.030421 ip-10-0-143-9 kubenswrapper[2567]: I0919 01:52:23.030399    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-k7jjx_68648148-0ad9-4533-86db-1061062b22ba/graceful-termination/0.log"