Jul 29 17:52:55.427618 ip-10-0-142-182 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 17:52:55.846702 ip-10-0-142-182 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:55.846702 ip-10-0-142-182 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 17:52:55.846702 ip-10-0-142-182 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:55.846702 ip-10-0-142-182 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 17:52:55.846702 ip-10-0-142-182 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 17:52:55.847728 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.847638    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 17:52:55.851601 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851578    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.851601 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851599    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.851601 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851603    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851608    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851612    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851616    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851620    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851623    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851626    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851629    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851637    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851640    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851643    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851646    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851648    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851651    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851654    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851656    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851659    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851661    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851664    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.851707 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851667    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851670    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851672    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851675    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851678    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851683    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851687    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851690    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851692    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851695    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851697    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851700    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851703    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851706    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851708    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851711    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851714    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851717    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851720    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851723    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.852166 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851726    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851728    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851731    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851733    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851736    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851738    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851741    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851744    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851747    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851750    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851752    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851754    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851757    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851759    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851766    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851770    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851773    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851776    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851780    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.852656 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851783    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851786    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851789    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851792    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851795    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851797    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851800    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851802    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851805    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851808    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851810    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851813    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851815    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851818    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851820    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851823    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851826    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851828    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851831    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851833    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.853164 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851836    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851839    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851841    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851843    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851846    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851849    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851851    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851855    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851858    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851862    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851865    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851869    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851871    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851874    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851876    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851879    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851881    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851884    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.853670 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.851887    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854110    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854119    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854124    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854129    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854132    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854135    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854138    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854141    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854145    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854148    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854151    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854154    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854157    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854160    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854163    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854165    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854168    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854171    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.854214 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854174    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854178    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854182    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854186    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854190    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854194    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854198    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854202    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854205    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854209    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854213    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854217    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854222    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854226    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854230    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854234    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854238    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854241    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854248    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854268    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.854764 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854273    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854278    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854282    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854288    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854292    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854296    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854301    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854305    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854309    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854313    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854316    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854320    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854326    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854334    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854340    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854345    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854349    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854354    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854358    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854363    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.855297 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854367    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854371    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854375    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854380    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854383    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854395    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854399    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854401    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854404    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854407    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854410    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854413    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854415    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854418    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854421    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854423    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854429    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854432    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854434    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.855790 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854437    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854439    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854442    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854445    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854448    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854451    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854454    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854456    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854459    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854462    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854465    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854467    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854469    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854472    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854474    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854477    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854480    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854483    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854485    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854487    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.856328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854490    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854493    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854945    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854950    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854953    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854956    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854959    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854962    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854964    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854968    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854971    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854973    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854976    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854979    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854982    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854985    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854988    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854991    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854994    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854997    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.856862 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.854999    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855002    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855004    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855007    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855011    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855014    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855017    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855020    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855023    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855025    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855028    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855030    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855033    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855035    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855038    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855041    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855043    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855048    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855051    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.857721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855053    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855056    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855058    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855061    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855064    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855067    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855070    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855072    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855075    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855078    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855080    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855083    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855086    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855088    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855091    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855093    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855096    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855099    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855101    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855104    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.858192 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855106    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855109    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855111    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855113    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855117    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855120    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855123    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855126    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855128    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855131    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855135    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855138    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855140    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855143    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855146    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855148    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855152    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855154    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855157    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.858885 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855159    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855163    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855167    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855169    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855173    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855175    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855178    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855181    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855183    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855185    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855188    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855190    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855194    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855197    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855199    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855202    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855204    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855207    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855209    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.859388 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855212    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855214    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855217    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.855219    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855314    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855323    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855329    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855334    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855339    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855342    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855346    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855352    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855355    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855359    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855362    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855366    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855369    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855372    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855376    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855379    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855382    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855384    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855389    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 29 17:52:55.859878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855393    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855396    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855399    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855402    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855406    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855410    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855413    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855417    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855420    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855423    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855426    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855429    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855432    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855437    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855440    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855443    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855446    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855449    2563 flags.go:64] FLAG: --enable-server="true"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855453    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855457    2563 flags.go:64] FLAG: --event-burst="100"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855460    2563 flags.go:64] FLAG: --event-qps="50"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855464    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855467    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855471    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 29 17:52:55.860456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855475    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855478    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855482    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855485    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855488    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855491    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855494    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855497    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855500    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855503    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855506    2563 flags.go:64] FLAG: --feature-gates=""
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855509    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855512    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855516    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855519    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855522    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855525    2563 flags.go:64] FLAG: --help="false"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855528    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-142-182.ec2.internal"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855531    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855534    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855537    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855541    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855544    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855547    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 17:52:55.861043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855550    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855553    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855556    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855559    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855562    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855564    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855568    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855571    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855574    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855578    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855580    2563 flags.go:64] FLAG: --lock-file=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855583    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855586    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855589    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855595    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855598    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855602    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855605    2563 flags.go:64] FLAG: --logging-format="text"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855607    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855611    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855614    2563 flags.go:64] FLAG: --manifest-url=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855616    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855621    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855623    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855628    2563 flags.go:64] FLAG: --max-pods="110"
Jul 29 17:52:55.861709 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855632    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855635    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855638    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855641    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855644    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855647    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855650    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855660    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855663    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855666    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855669    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855672    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855679    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855682    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855685    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855689    2563 flags.go:64] FLAG: --port="10250"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855692    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855695    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0707847db9d9e6ddf"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855698    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855702    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855705    2563 flags.go:64] FLAG: --register-node="true"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855707    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855711    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855714    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 29 17:52:55.862394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855717    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855720    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855723    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855726    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855729    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855732    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855735    2563 flags.go:64] FLAG: --runonce="false"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855738    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855741    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855744    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855747    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855750    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855753    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855757    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855760    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855764    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855767    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855770    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855773    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855776    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855779    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855781    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855787    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855791    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855794    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 17:52:55.863004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855801    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855804    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855807    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855810    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855813    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855816    2563 flags.go:64] FLAG: --v="2"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855820    2563 flags.go:64] FLAG: --version="false"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855825    2563 flags.go:64] FLAG: --vmodule=""
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855828    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.855832    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857103    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857122    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857132    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857140    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857147    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857153    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857158    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857164    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857169    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857182    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857187    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857192    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.863634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857196    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857201    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857206    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857210    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857216    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857220    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857225    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857229    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857235    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857240    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857250    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857271    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857275    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857279    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857284    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857289    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857293    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857298    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857303    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.864302 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857307    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857312    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857317    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857327    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857333    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857337    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857342    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857346    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857351    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857356    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857360    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857365    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857370    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857374    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857378    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857383    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857392    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857400    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857407    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.864804 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857413    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857421    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857427    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857432    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857438    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857443    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857450    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857456    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857460    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857470    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857475    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857480    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857485    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857490    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857495    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857506    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857510    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857515    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857520    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.865317 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857524    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857529    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857540    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857545    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857549    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857554    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857558    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857563    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857568    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857573    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857578    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857583    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857588    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857593    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857603    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857608    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857612    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857616    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857622    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857627    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.865809 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857631    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857636    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857641    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857645    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857650    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857654    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857659    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857668    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857675    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.857679    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.866328 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.858453    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:55.866601 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.866480    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 17:52:55.866601 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.866508    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 17:52:55.867409 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.867394    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 17:52:55.867450 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.867410    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 17:52:55.867509 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867498    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867509    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867515    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867520    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867525    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867529    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867535    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.867541 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867542    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867547    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867552    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867556    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867560    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867565    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867569    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867572    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867577    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867580    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867585    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867589    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867593    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867597    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867601    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867604    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867608    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867613    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867616    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867619    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.867718 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867623    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867626    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867630    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867634    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867639    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867642    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867646    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867650    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867653    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867657    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867661    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867664    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867668    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867672    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867677    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867681    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867685    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867688    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867692    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867695    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.868211 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867699    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867703    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867708    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867712    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867715    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867719    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867722    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867726    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867731    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867734    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867738    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867741    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867745    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867750    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867754    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867758    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867761    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867765    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867768    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867772    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.868836 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867777    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867780    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867783    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867787    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867790    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867794    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867799    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867804    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867807    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867811    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867814    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867818    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867822    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867827    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867831    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867834    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867838    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867842    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867846    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867852    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.869343 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867857    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867863    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867868    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867873    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867876    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867880    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867884    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867887    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867891    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867895    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867899    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.867903    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.867910    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868084    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 17:52:55.869882 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868092    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868097    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868103    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868106    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868111    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868116    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868121    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868125    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868129    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868133    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868138    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868142    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868146    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868150    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868154    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868158    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868161    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868164    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868168    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868172    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 17:52:55.870223 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868175    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868179    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868184    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868188    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868192    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868195    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868200    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868204    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868208    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868211    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868215    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868219    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868223    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868227    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868230    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868233    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868238    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868243    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868249    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 17:52:55.870737 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868268    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868273    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868278    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868283    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868287    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868291    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868295    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868299    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868303    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868307    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868311    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868314    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868318    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868323    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868327    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868331    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868336    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868340    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868343    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868347    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 17:52:55.871196 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868351    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868355    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868359    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868363    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868366    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868369    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868373    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868377    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868382    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868386    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868391    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868395    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868399    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868405    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868410    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868414    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868418    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868422    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868427    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868430    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 17:52:55.871706 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868434    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868438    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868442    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868446    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868450    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868454    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868457    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868462    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868466    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868472    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868476    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868480    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868483    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868487    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868493    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868497    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868501    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868505    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 17:52:55.872193 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:55.868508    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 17:52:55.872648 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.868516    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 17:52:55.872648 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.868709    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 17:52:55.872648 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.871379    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 17:52:55.872854 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.872837    2563 server.go:1019] "Starting client certificate rotation"
Jul 29 17:52:55.872976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.872957    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 17:52:55.873016 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.873006    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 17:52:55.875840 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.875820    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 17:52:55.877109 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.877078    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 17:52:55.889650 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.889625    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 29 17:52:55.892152 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.892128    2563 log.go:25] "Validated CRI v1 image API"
Jul 29 17:52:55.893126 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.893108    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 17:52:55.896627 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.896605    2563 fs.go:135] Filesystem UUIDs: map[2f21ef82-adea-419c-9d3d-fc2ad0437a09:/dev/nvme0n1p3 40cf8dd8-b83d-499e-a0a2-54250b54ea40:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 29 17:52:55.896695 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.896626    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 17:52:55.904366 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.904186    2563 manager.go:216] Machine: {Timestamp:2026-07-29 17:52:55.902743104 +0000 UTC m=+0.352724123 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3074897 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d2f1bd3126c936f016eb27d80e80c SystemUUID:ec2d2f1b-d312-6c93-6f01-6eb27d80e80c BootID:43512842-bc57-453b-bae6-f4d959534c05 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:db:e3:eb:91 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:db:e3:eb:91 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:76:67:71:7e:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 17:52:55.904366 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.904335    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 17:52:55.904572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.904466    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 17:52:55.907458 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.907423    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 17:52:55.907613 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.907461    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 17:52:55.908332 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.908320    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 17:52:55.908332 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.908334    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 17:52:55.908411 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.908342    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 17:52:55.909130 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.909115    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 17:52:55.910248 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.910237    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 17:52:55.911679 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.911657    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 17:52:55.912585 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912573    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 17:52:55.912713 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912704    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 17:52:55.912756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912734    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 17:52:55.912756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912751    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 17:52:55.912826 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912762    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 17:52:55.912826 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912772    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 29 17:52:55.912826 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.912780    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 17:52:55.913155 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.913144    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 17:52:55.913194 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.913164    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 17:52:55.915705 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.915681    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 17:52:55.918070 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.918052    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 17:52:55.918139 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.918084    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 17:52:55.920265 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920241    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920274    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920281    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920286    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920295    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920301    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920310    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 17:52:55.920314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920315    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 17:52:55.920565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920324    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 17:52:55.920565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920331    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 17:52:55.920565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920340    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 17:52:55.920565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.920345    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 17:52:55.921192 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.921180    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 17:52:55.921192 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.921189    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 17:52:55.924559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.924540    2563 server.go:1268] "Started kubelet"
Jul 29 17:52:55.924684 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.924652    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 17:52:55.924744 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.924701    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 17:52:55.925407 ip-10-0-142-182 systemd[1]: Started Kubernetes Kubelet.
Jul 29 17:52:55.925967 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.925464    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 17:52:55.926645 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.926570    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 17:52:55.928559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.928542    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 17:52:55.929508 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.929484    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 17:52:55.929587 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.929539    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 17:52:55.929587 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.929551    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 17:52:55.932968 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.932943    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 17:52:55.935620 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.935598    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 17:52:55.935720 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.935621    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 17:52:55.936363 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936331    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 17:52:55.936498 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936486    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 17:52:55.936608 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936493    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 17:52:55.936671 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.936357    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:55.936725 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936690    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 17:52:55.936725 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936699    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 17:52:55.936808 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936791    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 17:52:55.936808 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936806    2563 factory.go:55] Registering systemd factory
Jul 29 17:52:55.936899 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.936816    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 29 17:52:55.937095 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.937078    2563 factory.go:153] Registering CRI-O factory
Jul 29 17:52:55.937095 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.937094    2563 factory.go:223] Registration of the crio container factory successfully
Jul 29 17:52:55.937245 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.937119    2563 factory.go:103] Registering Raw factory
Jul 29 17:52:55.937245 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.937133    2563 manager.go:1196] Started watching for new ooms in manager
Jul 29 17:52:55.937245 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.935942    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-182.ec2.internal.18c6d4293f95d071  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-182.ec2.internal,UID:ip-10-0-142-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-182.ec2.internal,},FirstTimestamp:2026-07-29 17:52:55.924510833 +0000 UTC m=+0.374491850,LastTimestamp:2026-07-29 17:52:55.924510833 +0000 UTC m=+0.374491850,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-182.ec2.internal,}"
Jul 29 17:52:55.937560 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.937548    2563 manager.go:349] Starting recovery of all containers
Jul 29 17:52:55.949226 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.949183    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 17:52:55.949425 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.949366    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 17:52:55.950162 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.950137    2563 manager.go:354] Recovery completed
Jul 29 17:52:55.954853 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.954838    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:55.957188 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957166    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:55.957326 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957201    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:55.957326 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957216    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:55.957837 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957821    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 17:52:55.957837 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957835    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 17:52:55.957964 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957837    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:55.957964 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.957852    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 17:52:55.958633 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.958617    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:55.958685 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.958652    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:55.958685 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.958667    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:55.959998 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.959986    2563 policy_none.go:49] "None policy: Start"
Jul 29 17:52:55.960036 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.960002    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 17:52:55.960036 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.960013    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 17:52:55.961291 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.961279    2563 policy_none.go:47] "Start"
Jul 29 17:52:55.961788 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.961711    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-182.ec2.internal.18c6d429418865dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-182.ec2.internal,UID:ip-10-0-142-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-182.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-182.ec2.internal,},FirstTimestamp:2026-07-29 17:52:55.957186013 +0000 UTC m=+0.407167030,LastTimestamp:2026-07-29 17:52:55.957186013 +0000 UTC m=+0.407167030,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-182.ec2.internal,}"
Jul 29 17:52:55.972307 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.972213    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-182.ec2.internal.18c6d4294188bcfe  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-182.ec2.internal,UID:ip-10-0-142-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-182.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-182.ec2.internal,},FirstTimestamp:2026-07-29 17:52:55.957208318 +0000 UTC m=+0.407189335,LastTimestamp:2026-07-29 17:52:55.957208318 +0000 UTC m=+0.407189335,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-182.ec2.internal,}"
Jul 29 17:52:55.977377 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.977355    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mfc5"
Jul 29 17:52:55.986970 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:55.986893    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-182.ec2.internal.18c6d4294188ec18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-182.ec2.internal,UID:ip-10-0-142-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-182.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-182.ec2.internal,},FirstTimestamp:2026-07-29 17:52:55.957220376 +0000 UTC m=+0.407201394,LastTimestamp:2026-07-29 17:52:55.957220376 +0000 UTC m=+0.407201394,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-182.ec2.internal,}"
Jul 29 17:52:55.989129 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:55.989110    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2mfc5"
Jul 29 17:52:56.004866 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.004850    2563 manager.go:337] "Starting Device Plugin manager"
Jul 29 17:52:56.004963 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.004893    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 17:52:56.004963 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.004904    2563 server.go:87] "Starting device plugin registration server"
Jul 29 17:52:56.005354 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.005182    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 17:52:56.005415 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.005361    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 17:52:56.005492 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.005467    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 17:52:56.005668 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.005626    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 17:52:56.005668 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.005644    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 17:52:56.006513 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.006068    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 17:52:56.006596 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.006540    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:56.101527 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.101455    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 17:52:56.102656 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.102640    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 17:52:56.102726 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.102682    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 17:52:56.102726 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.102704    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 17:52:56.102815 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.102745    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 17:52:56.105495 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.105476    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:56.106016 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.106000    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:56.106314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.106299    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:56.106380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.106327    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:56.106380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.106341    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:56.106380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.106362    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.113379 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.113364    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.113437 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.113387    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-182.ec2.internal\": node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:56.148716 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.148683    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:56.203295 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.203237    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"]
Jul 29 17:52:56.203407 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.203335    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:56.205003 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.204980    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:56.205108 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.205017    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:56.205108 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.205034    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:56.206539 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.206525    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:56.206704 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.206689    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.206744 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.206722    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:56.207334 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207320    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:56.207413 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207344    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:56.207413 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207323    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:56.207413 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207380    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:56.207413 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207393    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:56.207413 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.207353    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:56.208749 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.208734    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.208816 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.208759    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 17:52:56.209503 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.209486    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 17:52:56.209587 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.209519    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 17:52:56.209587 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.209534    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeHasSufficientPID"
Jul 29 17:52:56.232354 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.232323    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-182.ec2.internal\" not found" node="ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.237190 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.237171    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-182.ec2.internal\" not found" node="ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.239281 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.239240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.239348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.239300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/276e8303a183e235d090627747bbcd3f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-182.ec2.internal\" (UID: \"276e8303a183e235d090627747bbcd3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.239348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.239337    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.249374 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.249344    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:56.339725 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.339725 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339732    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.339936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339794    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.339936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339839    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/276e8303a183e235d090627747bbcd3f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-182.ec2.internal\" (UID: \"276e8303a183e235d090627747bbcd3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.339936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/889c2e0296e90e5438c325d819b03acc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal\" (UID: \"889c2e0296e90e5438c325d819b03acc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.339936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:56.339858    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/276e8303a183e235d090627747bbcd3f-config\") pod \"kube-apiserver-proxy-ip-10-0-142-182.ec2.internal\" (UID: \"276e8303a183e235d090627747bbcd3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:56.349851 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:56.349818    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:57.927916 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:57.927873    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:58.012378 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.012332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:58.017786 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.017767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:58.027972 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.027944    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:58.128644 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.128545    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:58.229183 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.229151    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-182.ec2.internal\" not found"
Jul 29 17:52:58.269311 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.268096    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:58.313345 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.313300    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:58.334539 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.334504    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 17:52:58.337226 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.337211    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:58.349516 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.349489    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 17:52:58.349694 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.349670    2563 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.142.182:37756->34.196.127.173:6443: use of closed network connection"
Jul 29 17:52:58.349757 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.349729    2563 kubelet.go:3250] "Failed creating a mirror pod" err="unexpected error when reading response body. Please retry. Original error: read tcp 10.0.142.182:37756->34.196.127.173:6443: use of closed network connection" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal"
Jul 29 17:52:58.349757 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.349675    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 17:52:58.349757 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.349675    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 17:52:58.381338 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.381262    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:58.390729 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.390702    2563 apiserver.go:52] "Watching apiserver"
Jul 29 17:52:58.400317 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.400291    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 17:52:58.400650 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.400627    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-mdjn9","openshift-multus/multus-jd8bw","openshift-multus/network-metrics-daemon-2g4rv","openshift-network-operator/iptables-alerter-flsqk","kube-system/global-pull-secret-syncer-dtp7s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672","openshift-cluster-node-tuning-operator/tuned-fvlt8","openshift-dns/node-resolver-6vvn4","openshift-image-registry/node-ca-9qcqs","openshift-network-diagnostics/network-check-target-hnzzd","openshift-ovn-kubernetes/ovnkube-node-95zhz","kube-system/konnectivity-agent-958fx","kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal"]
Jul 29 17:52:58.402449 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.402427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.404251 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.404229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.405632 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.405612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.405723 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.405691    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:52:58.407046 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.407025    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.408538 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.408521    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.408612 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.408572    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:52:58.409955 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.409935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.411411 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.411394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.412791 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.412776    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.412791 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.412774    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 17:52:58.414274 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.414253    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.415695 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.415676    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:52:58.415793 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.415771    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:52:58.417589 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.417573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.419394 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.419369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.420120 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420099    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.420289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-socket-dir-parent\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.420289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-sys-fs\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.420289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.420289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420231    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 17:52:58.420289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420267    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-conf-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420404    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-kubelet-config\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420331    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-kubernetes\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-sys\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/405c33c3-79b1-4f64-8148-2189f0113caa-serviceca\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420534    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-kubelet\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420573    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420580    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-f9pwc\""
Jul 29 17:52:58.420612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420612    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-etc-kubernetes\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-systemd\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-run\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420702    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420703    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwgts\" (UniqueName: \"kubernetes.io/projected/066f8843-d3ef-4c0b-80a3-135fcc56338f-kube-api-access-zwgts\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-dbus\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420347    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420774    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-device-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420812    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-lib-modules\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420838    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-tuned\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-tmp\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cnibin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-k8s-cni-cncf-io\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.420995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4hw7\" (UniqueName: \"kubernetes.io/projected/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-kube-api-access-r4hw7\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.421260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421015    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h7mq\" (UniqueName: \"kubernetes.io/projected/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-kube-api-access-8h7mq\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421034    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ldp\" (UniqueName: \"kubernetes.io/projected/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-kube-api-access-p4ldp\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421055    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-registration-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421077    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxrl\" (UniqueName: \"kubernetes.io/projected/405c33c3-79b1-4f64-8148-2189f0113caa-kube-api-access-pxxrl\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421093    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-host-slash\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-socket-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-system-cni-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-os-release\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cni-binary-copy\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421254    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-daemon-config\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421276    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-modprobe-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/405c33c3-79b1-4f64-8148-2189f0113caa-host\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-hostroot\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421372    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/0f212d51-5b2b-43fc-863c-8cf1d88c8324-kube-api-access-xmwmm\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.422437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-netns\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421442    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-bin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421480    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtspd\" (UniqueName: \"kubernetes.io/projected/57f01021-0f93-4619-954e-3d987e762fbd-kube-api-access-rtspd\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421521    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f168e0-407a-4adb-8d08-44483048aa7f-tmp-dir\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421524    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-zqpnk\""
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421562    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-os-release\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-iptables-alerter-script\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-conf\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-host\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421674    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-multus\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3f168e0-407a-4adb-8d08-44483048aa7f-hosts-file\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421733    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-multus-certs\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421757    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421780    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421804    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptdxz\" (UniqueName: \"kubernetes.io/projected/d3f168e0-407a-4adb-8d08-44483048aa7f-kube-api-access-ptdxz\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421825    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cnibin\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.423374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421894    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-system-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421912    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysconfig\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.421949    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-var-lib-kubelet\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.422850    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.423266    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.423689    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.423882    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-424rr\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.424021    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gl8f5\""
Jul 29 17:52:58.424313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.424125    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.424710 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.424539    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z5hkw\""
Jul 29 17:52:58.424710 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.424609    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cfgjb\""
Jul 29 17:52:58.424774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.424733    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 17:52:58.425389 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.425371    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 17:52:58.425757 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.425728    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.427534 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.427514    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 17:52:58.428260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428082    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 17:52:58.428260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428113    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 17:52:58.428260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428141    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xd9ws\""
Jul 29 17:52:58.428260 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428178    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nlzcj\""
Jul 29 17:52:58.428727 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 17:52:58.428727 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428357    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 17:52:58.428727 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428410    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 17:52:58.428727 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9z6nk\""
Jul 29 17:52:58.428727 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.428519    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 17:52:58.438053 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.438029    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 17:52:58.472026 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.471976    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 17:47:57 +0000 UTC" deadline="2028-03-30 07:57:09.631211753 +0000 UTC"
Jul 29 17:52:58.472026 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.472021    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14630h4m11.159192622s"
Jul 29 17:52:58.481139 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.481109    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kgqg7"
Jul 29 17:52:58.495034 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.495007    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kgqg7"
Jul 29 17:52:58.515134 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.515106    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 17:52:58.522524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522496    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-tmp\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.522666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-systemd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.522666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0107231b-667f-481a-8a44-faaeac9268f7-konnectivity-ca\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.522666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522599    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.522666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.522666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522642    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cnibin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-k8s-cni-cncf-io\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4hw7\" (UniqueName: \"kubernetes.io/projected/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-kube-api-access-r4hw7\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522752    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-log-socket\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-k8s-cni-cncf-io\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h7mq\" (UniqueName: \"kubernetes.io/projected/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-kube-api-access-8h7mq\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cnibin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522849    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ldp\" (UniqueName: \"kubernetes.io/projected/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-kube-api-access-p4ldp\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522895    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-registration-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522900    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxrl\" (UniqueName: \"kubernetes.io/projected/405c33c3-79b1-4f64-8148-2189f0113caa-kube-api-access-pxxrl\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.522948 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-host-slash\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-socket-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.522992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-var-lib-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523018    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-system-cni-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-os-release\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cni-binary-copy\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523087    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-daemon-config\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523098    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-registration-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523111    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523149    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-socket-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-os-release\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523215    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-host-slash\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523242    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-system-cni-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-modprobe-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.523246    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.523346    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:52:59.023296342 +0000 UTC m=+1.996338513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:58.523442 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523304    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/405c33c3-79b1-4f64-8148-2189f0113caa-host\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523392    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-netns\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/405c33c3-79b1-4f64-8148-2189f0113caa-host\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523366    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-modprobe-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523420    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-hostroot\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/0f212d51-5b2b-43fc-863c-8cf1d88c8324-kube-api-access-xmwmm\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-hostroot\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-netns\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523569    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-bin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523593    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtspd\" (UniqueName: \"kubernetes.io/projected/57f01021-0f93-4619-954e-3d987e762fbd-kube-api-access-rtspd\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f168e0-407a-4adb-8d08-44483048aa7f-tmp-dir\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523642    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-slash\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523658    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-bin\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523665    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-os-release\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523673    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-daemon-config\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-iptables-alerter-script\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.524107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-os-release\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523722    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-netns\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523841    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-conf\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-conf\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-host\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1940aef-6f29-4cee-bad6-a861654593f1-ovn-node-metrics-cert\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f168e0-407a-4adb-8d08-44483048aa7f-tmp-dir\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-host\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-ovn\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.523997    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-node-log\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524035    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-netd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.524059    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524062    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-multus\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3f168e0-407a-4adb-8d08-44483048aa7f-hosts-file\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524163    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-cni-multus\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.524920 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.524250    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:52:59.024230568 +0000 UTC m=+1.997272727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524247    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d3f168e0-407a-4adb-8d08-44483048aa7f-hosts-file\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-iptables-alerter-script\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524320    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0f212d51-5b2b-43fc-863c-8cf1d88c8324-cni-binary-copy\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-multus-certs\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524364    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-run-multus-certs\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptdxz\" (UniqueName: \"kubernetes.io/projected/d3f168e0-407a-4adb-8d08-44483048aa7f-kube-api-access-ptdxz\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524479    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-kubelet\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524507    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-systemd-units\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524575    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-env-overrides\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.525738 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cnibin\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-system-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysconfig\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-var-lib-kubelet\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-cnibin\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524821    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95hb5\" (UniqueName: \"kubernetes.io/projected/f1940aef-6f29-4cee-bad6-a861654593f1-kube-api-access-95hb5\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-system-cni-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524857    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysconfig\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-socket-dir-parent\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-var-lib-kubelet\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524914    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-sys-fs\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.524977    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-socket-dir-parent\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525011    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525054    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-config\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-sys-fs\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-conf-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.526515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-kubelet-config\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-sysctl-d\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525135    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-kubernetes\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525167    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-sys\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525205    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-multus-conf-dir\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/405c33c3-79b1-4f64-8148-2189f0113caa-serviceca\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-kubelet-config\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-kubelet\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525289    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-sys\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-kubernetes\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525332    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-host-var-lib-kubelet\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525334    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525390    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0107231b-667f-481a-8a44-faaeac9268f7-agent-certs\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525398    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525414    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-etc-kubernetes\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.527049 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-systemd\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525459    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-run\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f212d51-5b2b-43fc-863c-8cf1d88c8324-etc-kubernetes\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwgts\" (UniqueName: \"kubernetes.io/projected/066f8843-d3ef-4c0b-80a3-135fcc56338f-kube-api-access-zwgts\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-etc-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-systemd\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525541    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-bin\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-run\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-script-lib\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-dbus\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/405c33c3-79b1-4f64-8148-2189f0113caa-serviceca\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525703    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-dbus\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525707    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-device-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-lib-modules\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/57f01021-0f93-4619-954e-3d987e762fbd-device-dir\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-tuned\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.525902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/066f8843-d3ef-4c0b-80a3-135fcc56338f-lib-modules\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.527572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.526914    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-tmp\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.528088 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.528039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/066f8843-d3ef-4c0b-80a3-135fcc56338f-etc-tuned\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.540315 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.540267    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889c2e0296e90e5438c325d819b03acc.slice/crio-d14693960de6217dfd58756e37a967eceadea7c2754fbb2a64f2b9d5668c669e WatchSource:0}: Error finding container d14693960de6217dfd58756e37a967eceadea7c2754fbb2a64f2b9d5668c669e: Status 404 returned error can't find the container with id d14693960de6217dfd58756e37a967eceadea7c2754fbb2a64f2b9d5668c669e
Jul 29 17:52:58.545958 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.545940    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 17:52:58.558223 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.558053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxrl\" (UniqueName: \"kubernetes.io/projected/405c33c3-79b1-4f64-8148-2189f0113caa-kube-api-access-pxxrl\") pod \"node-ca-9qcqs\" (UID: \"405c33c3-79b1-4f64-8148-2189f0113caa\") " pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.558223 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.558068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtspd\" (UniqueName: \"kubernetes.io/projected/57f01021-0f93-4619-954e-3d987e762fbd-kube-api-access-rtspd\") pod \"aws-ebs-csi-driver-node-zd672\" (UID: \"57f01021-0f93-4619-954e-3d987e762fbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.558223 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.558096    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ldp\" (UniqueName: \"kubernetes.io/projected/b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c-kube-api-access-p4ldp\") pod \"iptables-alerter-flsqk\" (UID: \"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c\") " pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.558223 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.558213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h7mq\" (UniqueName: \"kubernetes.io/projected/b68cc3df-89a0-43b1-89e4-0b63d7affa7e-kube-api-access-8h7mq\") pod \"multus-additional-cni-plugins-mdjn9\" (UID: \"b68cc3df-89a0-43b1-89e4-0b63d7affa7e\") " pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.558524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.558213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptdxz\" (UniqueName: \"kubernetes.io/projected/d3f168e0-407a-4adb-8d08-44483048aa7f-kube-api-access-ptdxz\") pod \"node-resolver-6vvn4\" (UID: \"d3f168e0-407a-4adb-8d08-44483048aa7f\") " pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.560997 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.560966    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmwmm\" (UniqueName: \"kubernetes.io/projected/0f212d51-5b2b-43fc-863c-8cf1d88c8324-kube-api-access-xmwmm\") pod \"multus-jd8bw\" (UID: \"0f212d51-5b2b-43fc-863c-8cf1d88c8324\") " pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.561113 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.561089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4hw7\" (UniqueName: \"kubernetes.io/projected/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-kube-api-access-r4hw7\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:58.561250 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.561234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwgts\" (UniqueName: \"kubernetes.io/projected/066f8843-d3ef-4c0b-80a3-135fcc56338f-kube-api-access-zwgts\") pod \"tuned-fvlt8\" (UID: \"066f8843-d3ef-4c0b-80a3-135fcc56338f\") " pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.583211 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.583145    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal" event={"ID":"889c2e0296e90e5438c325d819b03acc","Type":"ContainerStarted","Data":"d14693960de6217dfd58756e37a967eceadea7c2754fbb2a64f2b9d5668c669e"}
Jul 29 17:52:58.626337 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626297    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626337 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626336    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0107231b-667f-481a-8a44-faaeac9268f7-agent-certs\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626359    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-etc-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626382    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-bin\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626404    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-script-lib\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626447    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-etc-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-systemd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0107231b-667f-481a-8a44-faaeac9268f7-konnectivity-ca\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.626580 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-log-socket\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-var-lib-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626598    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-systemd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-bin\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626635    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-netns\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-slash\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626669    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-log-socket\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626718    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-var-lib-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-slash\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1940aef-6f29-4cee-bad6-a861654593f1-ovn-node-metrics-cert\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626764    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-netns\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626789    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-ovn\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-node-log\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626869    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-ovn\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-netd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-cni-netd\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626950    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-node-log\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.626954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-run-openvswitch\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626996    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-run-ovn-kubernetes\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.626996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627037    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-kubelet\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0107231b-667f-481a-8a44-faaeac9268f7-konnectivity-ca\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627155    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-script-lib\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-systemd-units\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-systemd-units\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-env-overrides\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627587    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1940aef-6f29-4cee-bad6-a861654593f1-host-kubelet\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95hb5\" (UniqueName: \"kubernetes.io/projected/f1940aef-6f29-4cee-bad6-a861654593f1-kube-api-access-95hb5\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.627868 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-config\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.628276 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.627912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-env-overrides\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.628276 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.628121    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f1940aef-6f29-4cee-bad6-a861654593f1-ovnkube-config\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.628995 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.628968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1940aef-6f29-4cee-bad6-a861654593f1-ovn-node-metrics-cert\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.629091 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.629004    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0107231b-667f-481a-8a44-faaeac9268f7-agent-certs\") pod \"konnectivity-agent-958fx\" (UID: \"0107231b-667f-481a-8a44-faaeac9268f7\") " pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.636716 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.636652    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:58.636716 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.636675    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:58.636716 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.636686    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:58.636893 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:58.636745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:52:59.136730397 +0000 UTC m=+2.109772554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:58.640661 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.640639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95hb5\" (UniqueName: \"kubernetes.io/projected/f1940aef-6f29-4cee-bad6-a861654593f1-kube-api-access-95hb5\") pod \"ovnkube-node-95zhz\" (UID: \"f1940aef-6f29-4cee-bad6-a861654593f1\") " pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.649602 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.649576    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod276e8303a183e235d090627747bbcd3f.slice/crio-2d27e7887e3cb452de2d3f02758ddab67901e5f9c94e809eacee2f9aabbab15e WatchSource:0}: Error finding container 2d27e7887e3cb452de2d3f02758ddab67901e5f9c94e809eacee2f9aabbab15e: Status 404 returned error can't find the container with id 2d27e7887e3cb452de2d3f02758ddab67901e5f9c94e809eacee2f9aabbab15e
Jul 29 17:52:58.726858 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.726819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mdjn9"
Jul 29 17:52:58.734721 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.734691    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68cc3df_89a0_43b1_89e4_0b63d7affa7e.slice/crio-0d3ccb5971b9c41a0d9186011f1f96d20c58c8ec50c58633742d3a0993626701 WatchSource:0}: Error finding container 0d3ccb5971b9c41a0d9186011f1f96d20c58c8ec50c58633742d3a0993626701: Status 404 returned error can't find the container with id 0d3ccb5971b9c41a0d9186011f1f96d20c58c8ec50c58633742d3a0993626701
Jul 29 17:52:58.746557 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.746529    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jd8bw"
Jul 29 17:52:58.755119 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.755092    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f212d51_5b2b_43fc_863c_8cf1d88c8324.slice/crio-265e16926fbd1b89b0123fd3519a2da1ea93c7743ac33aeb0cb0ffd69278a6bc WatchSource:0}: Error finding container 265e16926fbd1b89b0123fd3519a2da1ea93c7743ac33aeb0cb0ffd69278a6bc: Status 404 returned error can't find the container with id 265e16926fbd1b89b0123fd3519a2da1ea93c7743ac33aeb0cb0ffd69278a6bc
Jul 29 17:52:58.760298 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.760276    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-flsqk"
Jul 29 17:52:58.764106 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.764085    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672"
Jul 29 17:52:58.772281 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.772248    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d2b14d_9dd2_4fa4_ba8a_dc730000b38c.slice/crio-d3f4f1834b2af2402e49a350359f56fa72af8fcec39e3a6704cbc0fe775fe3c9 WatchSource:0}: Error finding container d3f4f1834b2af2402e49a350359f56fa72af8fcec39e3a6704cbc0fe775fe3c9: Status 404 returned error can't find the container with id d3f4f1834b2af2402e49a350359f56fa72af8fcec39e3a6704cbc0fe775fe3c9
Jul 29 17:52:58.775018 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.774993    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f01021_0f93_4619_954e_3d987e762fbd.slice/crio-27146373f2f82cf2b1c583ea33ac748daed398d647e43e70622e1fd5181b2919 WatchSource:0}: Error finding container 27146373f2f82cf2b1c583ea33ac748daed398d647e43e70622e1fd5181b2919: Status 404 returned error can't find the container with id 27146373f2f82cf2b1c583ea33ac748daed398d647e43e70622e1fd5181b2919
Jul 29 17:52:58.779159 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.779132    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-fvlt8"
Jul 29 17:52:58.786730 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.786710    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod066f8843_d3ef_4c0b_80a3_135fcc56338f.slice/crio-f307510a318257038fb30903147770a8150787a9ea62985a9a4dc66f9dc04f72 WatchSource:0}: Error finding container f307510a318257038fb30903147770a8150787a9ea62985a9a4dc66f9dc04f72: Status 404 returned error can't find the container with id f307510a318257038fb30903147770a8150787a9ea62985a9a4dc66f9dc04f72
Jul 29 17:52:58.793438 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.793419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vvn4"
Jul 29 17:52:58.800987 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.800961    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f168e0_407a_4adb_8d08_44483048aa7f.slice/crio-767a7452d27acc50c58e64ea1045c393cca0cec5da69e2df00f8a119b164f352 WatchSource:0}: Error finding container 767a7452d27acc50c58e64ea1045c393cca0cec5da69e2df00f8a119b164f352: Status 404 returned error can't find the container with id 767a7452d27acc50c58e64ea1045c393cca0cec5da69e2df00f8a119b164f352
Jul 29 17:52:58.809284 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.809251    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9qcqs"
Jul 29 17:52:58.816928 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.816902    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod405c33c3_79b1_4f64_8148_2189f0113caa.slice/crio-5a66389fb397f20c14d6d9fedb1ad8f863438e1c640244e387922e701d4b44b9 WatchSource:0}: Error finding container 5a66389fb397f20c14d6d9fedb1ad8f863438e1c640244e387922e701d4b44b9: Status 404 returned error can't find the container with id 5a66389fb397f20c14d6d9fedb1ad8f863438e1c640244e387922e701d4b44b9
Jul 29 17:52:58.827114 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.827086    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:52:58.835319 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.835286    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1940aef_6f29_4cee_bad6_a861654593f1.slice/crio-02b46e0ffb09d05f175e87b0cb0932c9386b5824863f2ff37bda818850c4d853 WatchSource:0}: Error finding container 02b46e0ffb09d05f175e87b0cb0932c9386b5824863f2ff37bda818850c4d853: Status 404 returned error can't find the container with id 02b46e0ffb09d05f175e87b0cb0932c9386b5824863f2ff37bda818850c4d853
Jul 29 17:52:58.837487 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.837446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:52:58.845238 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:52:58.845212    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0107231b_667f_481a_8a44_faaeac9268f7.slice/crio-fee5c55a9e49fe9f5dc08fad96d676d4c89470f1cff6b50cf70f59ea1324842d WatchSource:0}: Error finding container fee5c55a9e49fe9f5dc08fad96d676d4c89470f1cff6b50cf70f59ea1324842d: Status 404 returned error can't find the container with id fee5c55a9e49fe9f5dc08fad96d676d4c89470f1cff6b50cf70f59ea1324842d
Jul 29 17:52:58.894341 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:58.894249    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:59.029975 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.029937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:52:59.030183 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.030036    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:52:59.030183 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.030116    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:59.030183 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.030138    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:59.030339 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.030208    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:00.030175568 +0000 UTC m=+3.003217727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:52:59.030339 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.030262    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:00.030249329 +0000 UTC m=+3.003291494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:52:59.202322 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.202237    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:52:59.232570 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.232494    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:52:59.232736 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.232680    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:52:59.232736 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.232700    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:52:59.232736 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.232713    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:59.232909 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:52:59.232772    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:00.232753749 +0000 UTC m=+3.205795927 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:52:59.497464 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.497282    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:47:58 +0000 UTC" deadline="2028-01-02 04:46:52.21438418 +0000 UTC"
Jul 29 17:52:59.497464 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.497344    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12514h53m52.717044611s"
Jul 29 17:52:59.600959 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.600873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerStarted","Data":"0d3ccb5971b9c41a0d9186011f1f96d20c58c8ec50c58633742d3a0993626701"}
Jul 29 17:52:59.608308 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.608265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal" event={"ID":"276e8303a183e235d090627747bbcd3f","Type":"ContainerStarted","Data":"2d27e7887e3cb452de2d3f02758ddab67901e5f9c94e809eacee2f9aabbab15e"}
Jul 29 17:52:59.622214 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.622158    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-958fx" event={"ID":"0107231b-667f-481a-8a44-faaeac9268f7","Type":"ContainerStarted","Data":"fee5c55a9e49fe9f5dc08fad96d676d4c89470f1cff6b50cf70f59ea1324842d"}
Jul 29 17:52:59.631764 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.631642    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fvlt8" event={"ID":"066f8843-d3ef-4c0b-80a3-135fcc56338f","Type":"ContainerStarted","Data":"f307510a318257038fb30903147770a8150787a9ea62985a9a4dc66f9dc04f72"}
Jul 29 17:52:59.643187 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.642937    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672" event={"ID":"57f01021-0f93-4619-954e-3d987e762fbd","Type":"ContainerStarted","Data":"27146373f2f82cf2b1c583ea33ac748daed398d647e43e70622e1fd5181b2919"}
Jul 29 17:52:59.649137 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.649066    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flsqk" event={"ID":"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c","Type":"ContainerStarted","Data":"d3f4f1834b2af2402e49a350359f56fa72af8fcec39e3a6704cbc0fe775fe3c9"}
Jul 29 17:52:59.668840 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.668797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"02b46e0ffb09d05f175e87b0cb0932c9386b5824863f2ff37bda818850c4d853"}
Jul 29 17:52:59.684718 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.684663    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qcqs" event={"ID":"405c33c3-79b1-4f64-8148-2189f0113caa","Type":"ContainerStarted","Data":"5a66389fb397f20c14d6d9fedb1ad8f863438e1c640244e387922e701d4b44b9"}
Jul 29 17:52:59.696162 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.696034    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vvn4" event={"ID":"d3f168e0-407a-4adb-8d08-44483048aa7f","Type":"ContainerStarted","Data":"767a7452d27acc50c58e64ea1045c393cca0cec5da69e2df00f8a119b164f352"}
Jul 29 17:52:59.726097 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:52:59.725982    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jd8bw" event={"ID":"0f212d51-5b2b-43fc-863c-8cf1d88c8324","Type":"ContainerStarted","Data":"265e16926fbd1b89b0123fd3519a2da1ea93c7743ac33aeb0cb0ffd69278a6bc"}
Jul 29 17:53:00.039585 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.039543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:00.039790 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.039604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:00.039790 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.039721    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:00.039790 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.039784    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:02.039762632 +0000 UTC m=+5.012804790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:00.040606 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.040583    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:00.040737 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.040643    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:02.040626472 +0000 UTC m=+5.013668630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:00.173797 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.173762    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 17:53:00.241131 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.241078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:00.241337 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.241284    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:00.241337 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.241307    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:00.241337 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.241320    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:00.241503 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.241378    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:02.241361106 +0000 UTC m=+5.214403264 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:00.497874 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.497750    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 17:47:58 +0000 UTC" deadline="2028-02-02 08:20:32.651316554 +0000 UTC"
Jul 29 17:53:00.497874 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.497793    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13262h27m32.153528446s"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.580165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.580364    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.580765    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.580854    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:00.580921    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:00.581072 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:00.581005    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:02.058883 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.058842    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:02.059421 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.058903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:02.059421 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.059059    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:02.059421 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.059119    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:06.059102072 +0000 UTC m=+9.032144233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:02.059421 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.059185    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:02.059421 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.059232    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:06.059219915 +0000 UTC m=+9.032262080 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:02.260615 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.260519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:02.260799 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.260697    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:02.260799 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.260715    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:02.260799 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.260728    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:02.260799 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.260790    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:06.260771821 +0000 UTC m=+9.233813982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:02.580272 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.580173    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:02.580429 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.580337    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:02.580429 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.580351    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:02.580547 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.580515    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:02.580607 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:02.580560    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:02.580717 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:02.580680    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:04.580540 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:04.580476    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:04.580540 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:04.580502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:04.580540 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:04.580470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:04.581112 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:04.580610    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:04.581112 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:04.581001    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:04.581212 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:04.581131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:06.095891 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.095843    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:06.096420 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.095924    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:06.096420 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.096096    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:06.096420 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.096172    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:14.096154483 +0000 UTC m=+17.069196644 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:06.096602 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.096575    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:06.096682 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.096662    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:14.096642956 +0000 UTC m=+17.069685129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:06.297822 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.297781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:06.298008 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.297991    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:06.298072 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.298016    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:06.298072 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.298031    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:06.298149 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.298110    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:14.298091535 +0000 UTC m=+17.271133697 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:06.580680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.580593    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:06.580847 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.580732    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:06.581157 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.581135    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:06.581342 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.581321    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:06.581433 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:06.581410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:06.581545 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:06.581522    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:08.580387 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:08.580295    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:08.580387 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:08.580307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:08.580927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:08.580428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:08.580927 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:08.580424    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:08.580927 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:08.580546    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:08.580927 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:08.580627    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:10.580124 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:10.580021    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:10.580124 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:10.580062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:10.580124 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:10.580062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:10.580624 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:10.580155    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:10.580624 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:10.580289    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:10.580624 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:10.580388    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:12.580151 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:12.580119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:12.580623 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:12.580119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:12.580623 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:12.580260    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:12.580623 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:12.580133    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:12.580623 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:12.580328    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:12.580623 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:12.580472    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:14.158954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.158912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:14.158954 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.158959    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:14.159470 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.159063    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:14.159470 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.159087    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:14.159470 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.159115    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:30.159100545 +0000 UTC m=+33.132142703 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:14.159470 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.159160    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:30.15914079 +0000 UTC m=+33.132182948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:14.360804 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.360766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:14.360997 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.360969    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:14.360997 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.361003    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:14.361254 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.361017    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:14.361254 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.361075    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:30.361058416 +0000 UTC m=+33.334100576 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:14.580506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.580420    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:14.580707 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.580540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:14.580707 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.580549    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:14.580707 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:14.580576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:14.580707 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.580663    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:14.580903 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:14.580740    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:16.580950 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:16.580763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:16.581427 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:16.580763    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:16.581427 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:16.581047    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:16.581427 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:16.580762    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:16.581427 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:16.581117    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:16.581427 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:16.581221    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:18.580772 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.580732    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:18.581232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.580783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:18.581232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.580785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:18.581232 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:18.580869    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:18.581232 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:18.580949    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:18.581232 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:18.581069    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:18.772925 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.772890    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jd8bw" event={"ID":"0f212d51-5b2b-43fc-863c-8cf1d88c8324","Type":"ContainerStarted","Data":"36c53840ac2d2b0d522d87650cd1f50256555d2e4311e1f4768300cbad7ac824"}
Jul 29 17:53:18.774539 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.774511    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal" event={"ID":"276e8303a183e235d090627747bbcd3f","Type":"ContainerStarted","Data":"40844bb671a817508e9648f46d6b6d61c1dda726e001b81f79d2b59fb946952e"}
Jul 29 17:53:18.775822 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.775799    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-fvlt8" event={"ID":"066f8843-d3ef-4c0b-80a3-135fcc56338f","Type":"ContainerStarted","Data":"4ac0f8b5c6a6abd4cb682a945b4f6766a904cfd46d411e82cfbd1be2f998d87e"}
Jul 29 17:53:18.794313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.794268    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jd8bw" podStartSLOduration=1.933393374 podStartE2EDuration="21.79425326s" totalImagesPullingTime="19.860859886s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:18.793901653 +0000 UTC m=+21.766943832" watchObservedRunningTime="2026-07-29 17:53:18.79425326 +0000 UTC m=+21.767295453"
Jul 29 17:53:18.814233 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:18.813915    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-fvlt8" podStartSLOduration=2.199248274 podStartE2EDuration="21.813892859s" totalImagesPullingTime="19.614644585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:18.813350131 +0000 UTC m=+21.786392313" watchObservedRunningTime="2026-07-29 17:53:18.813892859 +0000 UTC m=+21.786935042"
Jul 29 17:53:19.779321 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.779107    2563 generic.go:356] "Generic (PLEG): container finished" podID="889c2e0296e90e5438c325d819b03acc" containerID="fc49566e393f99441d4cbd71af26fdbce71648e152fe771aec1ca85c39cb25d5" exitCode=0
Jul 29 17:53:19.780091 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.779181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal" event={"ID":"889c2e0296e90e5438c325d819b03acc","Type":"ContainerDied","Data":"fc49566e393f99441d4cbd71af26fdbce71648e152fe771aec1ca85c39cb25d5"}
Jul 29 17:53:19.781779 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.781757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:53:19.782127 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.782108    2563 generic.go:356] "Generic (PLEG): container finished" podID="f1940aef-6f29-4cee-bad6-a861654593f1" containerID="7b17b85f9337257c2f9e91f8a6e38ca70121ce6c36208a44f92362e8b7af7079" exitCode=1
Jul 29 17:53:19.782241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.782182    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"f5c39c6ba3d976c8a6e8d6243c364100f74045e5126b05c2c40a2cfa17a02a08"}
Jul 29 17:53:19.782301 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.782285    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"df55b22e4a8dea1c9f4d8db013ce2e4431d24335cf336d4f8f1577ccce9a0655"}
Jul 29 17:53:19.782338 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.782316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerDied","Data":"7b17b85f9337257c2f9e91f8a6e38ca70121ce6c36208a44f92362e8b7af7079"}
Jul 29 17:53:19.782381 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.782349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"7234758994e9a0f958f9aa7d23e86d04a3e9a1f40d900cb0823ea9b8b19dd126"}
Jul 29 17:53:19.783501 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.783477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9qcqs" event={"ID":"405c33c3-79b1-4f64-8148-2189f0113caa","Type":"ContainerStarted","Data":"99a78ca5d218790c1bd5d4bfeee11c0cbac514bd15b1fb9841f184cbe3bd9c1d"}
Jul 29 17:53:19.784766 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.784741    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vvn4" event={"ID":"d3f168e0-407a-4adb-8d08-44483048aa7f","Type":"ContainerStarted","Data":"c84a9c4ab1df8fc1cb8d858165e30f04d4b8e8bf1a14ffca5cca8684a36deb44"}
Jul 29 17:53:19.786034 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.786008    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="fa7ba028eeabc30f5a81fc70ed44aa0d42f2e2fde04c715864dda7ae092e6faf" exitCode=0
Jul 29 17:53:19.786112 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.786080    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"fa7ba028eeabc30f5a81fc70ed44aa0d42f2e2fde04c715864dda7ae092e6faf"}
Jul 29 17:53:19.787506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.787477    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-958fx" event={"ID":"0107231b-667f-481a-8a44-faaeac9268f7","Type":"ContainerStarted","Data":"f9680c247f1c0ca60e1c6487eeec5149e8d3980e177f0d4246d4ec7cfa9a824e"}
Jul 29 17:53:19.788765 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.788746    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672" event={"ID":"57f01021-0f93-4619-954e-3d987e762fbd","Type":"ContainerStarted","Data":"5987b33841c83aabba8c3ca683c08c6fbad289af1d0994aca581a22b781aa1a3"}
Jul 29 17:53:19.798112 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.798072    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9qcqs" podStartSLOduration=3.233800239 podStartE2EDuration="22.798058161s" totalImagesPullingTime="19.564257922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:19.797875568 +0000 UTC m=+22.770917803" watchObservedRunningTime="2026-07-29 17:53:19.798058161 +0000 UTC m=+22.771100341"
Jul 29 17:53:19.798428 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.798400    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-182.ec2.internal" podStartSLOduration=21.798361642 podStartE2EDuration="21.798361642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:18.828998533 +0000 UTC m=+21.802040714" watchObservedRunningTime="2026-07-29 17:53:19.798361642 +0000 UTC m=+22.771403822"
Jul 29 17:53:19.836897 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.836849    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6vvn4" podStartSLOduration=3.238610733 podStartE2EDuration="22.836834498s" totalImagesPullingTime="19.598223765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:19.83646971 +0000 UTC m=+22.809511890" watchObservedRunningTime="2026-07-29 17:53:19.836834498 +0000 UTC m=+22.809876678"
Jul 29 17:53:19.851326 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:19.851277    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-958fx" podStartSLOduration=3.315300023 podStartE2EDuration="22.851260387s" totalImagesPullingTime="19.535960364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:19.851154569 +0000 UTC m=+22.824196759" watchObservedRunningTime="2026-07-29 17:53:19.851260387 +0000 UTC m=+22.824302568"
Jul 29 17:53:20.580812 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.580766    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:20.580812 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.580798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:20.580812 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.580804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:20.581290 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:20.580883    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:20.581290 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:20.580954    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:20.581290 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:20.581006    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:20.795159 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.795131    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:53:20.795706 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.795677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"2b58ce15c25d9404b9384b65dee946e87758bd541c69b67b95da75960009146f"}
Jul 29 17:53:20.795800 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.795770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"317ed36ac067251d5a9796386cf14ddddf03728c113c36733d5d982ae6581dda"}
Jul 29 17:53:20.797400 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.797370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-flsqk" event={"ID":"b7d2b14d-9dd2-4fa4-ba8a-dc730000b38c","Type":"ContainerStarted","Data":"83da439611a89db1efb0d869a7441d8b05113158e20d3542fbdd00392540169c"}
Jul 29 17:53:20.812652 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.812594    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-flsqk" podStartSLOduration=4.18008114 podStartE2EDuration="23.812560486s" totalImagesPullingTime="19.632479346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:20.812474401 +0000 UTC m=+23.785516579" watchObservedRunningTime="2026-07-29 17:53:20.812560486 +0000 UTC m=+23.785602668"
Jul 29 17:53:20.857715 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:20.857567    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 17:53:21.495488 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.495277    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T17:53:20.857586608Z","UUID":"edbfee6c-3df5-4534-b793-d2d1b4a281e5","Handler":null,"Name":"","Endpoint":""}
Jul 29 17:53:21.497800 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.497711    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 17:53:21.497800 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.497777    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 17:53:21.802319 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.802232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672" event={"ID":"57f01021-0f93-4619-954e-3d987e762fbd","Type":"ContainerStarted","Data":"9ac13027af1436ddea0a7678e4d10339d7fb607e2ac08bca0d71dd7201ec41f3"}
Jul 29 17:53:21.804464 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.804404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal" event={"ID":"889c2e0296e90e5438c325d819b03acc","Type":"ContainerStarted","Data":"a81014039dbe772c57b42959ac1745b915946d16659d21af9a317a949f36943f"}
Jul 29 17:53:21.820185 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:21.820122    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-182.ec2.internal" podStartSLOduration=23.820102685 podStartE2EDuration="23.820102685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:21.819518185 +0000 UTC m=+24.792560367" watchObservedRunningTime="2026-07-29 17:53:21.820102685 +0000 UTC m=+24.793144863"
Jul 29 17:53:22.415014 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.414720    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:53:22.415376 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.415351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:53:22.580116 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.580079    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:22.580116 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.580119    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:22.580372 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:22.580239    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:22.580372 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:22.580299    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:22.580372 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.580349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:22.580569 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:22.580449    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:22.809469 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.809384    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:53:22.810013 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.809848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"bac10748f2190133cc8c8f93da8a5fc89279cb606ccea49a05d28c52e2892adb"}
Jul 29 17:53:22.812223 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.812178    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672" event={"ID":"57f01021-0f93-4619-954e-3d987e762fbd","Type":"ContainerStarted","Data":"6e803f1ff222b1fe6a42ebeba4b922ad546f3341df2f13fd6998f20ff93f038c"}
Jul 29 17:53:22.812673 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.812485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:53:22.813003 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.812983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-958fx"
Jul 29 17:53:22.838956 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:22.838895    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd672" podStartSLOduration=3.709708414 podStartE2EDuration="25.83887194s" totalImagesPullingTime="22.129163526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:22.838714457 +0000 UTC m=+25.811756638" watchObservedRunningTime="2026-07-29 17:53:22.83887194 +0000 UTC m=+25.811914121"
Jul 29 17:53:24.580303 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.580089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:24.581159 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.580127    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:24.581159 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:24.580394    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:24.581159 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:24.580508    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:24.581159 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.580141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:24.581159 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:24.580630    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:24.821075 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.820992    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:53:24.821476 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.821445    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"490c32a89579983ca9286e6130f2cd2201dba1d03016230ac5bd8f88b7cad1a4"}
Jul 29 17:53:24.821730 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.821700    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:24.821831 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.821816    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:24.821986 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.821968    2563 scope.go:117] "RemoveContainer" containerID="7b17b85f9337257c2f9e91f8a6e38ca70121ce6c36208a44f92362e8b7af7079"
Jul 29 17:53:24.823438 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.823409    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="1e123e6a2fc9745fde20bef55b87cb902c17abbd6507b0916fa7cf22a3cf951c" exitCode=0
Jul 29 17:53:24.823511 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.823470    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"1e123e6a2fc9745fde20bef55b87cb902c17abbd6507b0916fa7cf22a3cf951c"}
Jul 29 17:53:24.840315 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:24.840293    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:25.829468 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:25.829438    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:53:25.829998 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:25.829751    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" event={"ID":"f1940aef-6f29-4cee-bad6-a861654593f1","Type":"ContainerStarted","Data":"e8d7d92c643fd932807cadf4f727162cc930145519eac82b20e7289b0e68866b"}
Jul 29 17:53:25.830092 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:25.830075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:25.846003 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:25.845977    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:25.861180 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:25.861126    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz" podStartSLOduration=8.522431718 podStartE2EDuration="28.86111015s" totalImagesPullingTime="20.338678432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:25.860241585 +0000 UTC m=+28.833283775" watchObservedRunningTime="2026-07-29 17:53:25.86111015 +0000 UTC m=+28.834152327"
Jul 29 17:53:26.473865 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.472322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnzzd"]
Jul 29 17:53:26.473865 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.472710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:26.473865 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:26.472848    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:26.475451 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.475417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtp7s"]
Jul 29 17:53:26.475638 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.475552    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:26.475704 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:26.475674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:26.476068 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.476034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2g4rv"]
Jul 29 17:53:26.476178 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.476162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:26.476414 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:26.476293    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:26.844184 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.844146    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="276ef54acbb1a381dd48d0f5d532fa00b15c05bf0a8b28124de4dbb30e8e3c79" exitCode=0
Jul 29 17:53:26.844558 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:26.844233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"276ef54acbb1a381dd48d0f5d532fa00b15c05bf0a8b28124de4dbb30e8e3c79"}
Jul 29 17:53:27.580971 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:27.580942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:27.581252 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:27.581035    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:27.581252 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:27.581089    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:27.581252 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:27.581104    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:28.579982 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:28.579946    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:28.580489 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:28.580069    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:28.852291 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:28.852250    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="39c0c7807561273554dabf3b854aed157204dd2f080725ead24655b23e8f9b89" exitCode=0
Jul 29 17:53:28.852434 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:28.852315    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"39c0c7807561273554dabf3b854aed157204dd2f080725ead24655b23e8f9b89"}
Jul 29 17:53:29.580677 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:29.580638    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:29.581184 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:29.580776    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:29.581184 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:29.580835    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:29.581184 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:29.580952    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:30.176019 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.175984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:30.176019 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.176028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:30.176251 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.176156    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:30.176251 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.176157    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:30.176251 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.176238    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret podName:2dfe09fd-e275-4e17-9c9f-98a76e8f2936 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:02.176217435 +0000 UTC m=+65.149259596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret") pod "global-pull-secret-syncer-dtp7s" (UID: "2dfe09fd-e275-4e17-9c9f-98a76e8f2936") : object "kube-system"/"original-pull-secret" not registered
Jul 29 17:53:30.176418 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.176258    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:02.176247327 +0000 UTC m=+65.149289513 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 17:53:30.377597 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.377562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:30.377783 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.377701    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 17:53:30.377783 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.377720    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 17:53:30.377783 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.377729    2563 projected.go:196] Error preparing data for projected volume kube-api-access-cwrml for pod openshift-network-diagnostics/network-check-target-hnzzd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:30.377952 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.377785    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml podName:b17b2915-7587-4191-a44e-f1f3f761b033 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:02.377767494 +0000 UTC m=+65.350809658 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cwrml" (UniqueName: "kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml") pod "network-check-target-hnzzd" (UID: "b17b2915-7587-4191-a44e-f1f3f761b033") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 17:53:30.520494 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.520453    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:30.580438 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.580400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:30.580609 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:30.580567    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2g4rv" podUID="68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064"
Jul 29 17:53:30.626780 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.626739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:30.703352 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.703255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:30.803517 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.803484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:30.904844 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:30.904804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.075365 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.075263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.129427 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.129387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.436685 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.436646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.494756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.494716    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.580284 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.580228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:31.580448 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:31.580359    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hnzzd" podUID="b17b2915-7587-4191-a44e-f1f3f761b033"
Jul 29 17:53:31.580448 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.580435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:31.580580 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:31.580555    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dtp7s" podUID="2dfe09fd-e275-4e17-9c9f-98a76e8f2936"
Jul 29 17:53:31.853896 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.853863    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-182.ec2.internal" event="NodeReady"
Jul 29 17:53:31.854432 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.854007    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 17:53:31.884440 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.884398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:31.933872 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.932456    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-k4ln6"]
Jul 29 17:53:31.935876 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.935846    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:31.937139 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.937104    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fnhx4"]
Jul 29 17:53:31.938660 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.938635    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 17:53:31.938810 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.938683    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzsbz\""
Jul 29 17:53:31.938892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.938846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 17:53:31.939020 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.938999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:31.946240 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.946211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 17:53:31.946484 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.946461    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 17:53:31.946484 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.946478    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 17:53:31.946665 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.946618    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mh5gc\""
Jul 29 17:53:31.954372 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.954346    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k4ln6"]
Jul 29 17:53:31.957417 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.957378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnhx4"]
Jul 29 17:53:31.996173 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:31.996139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:32.091873 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.091832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-tmp-dir\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.091873 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.091871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtxzc\" (UniqueName: \"kubernetes.io/projected/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-kube-api-access-mtxzc\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.092106 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.091961    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zzff\" (UniqueName: \"kubernetes.io/projected/f5a20281-310c-49b8-814e-2866e60a1b12-kube-api-access-8zzff\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.092106 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.092010    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-config-volume\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.092221 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.092111    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5a20281-310c-49b8-814e-2866e60a1b12-cert\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.092221 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.092174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.192898 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zzff\" (UniqueName: \"kubernetes.io/projected/f5a20281-310c-49b8-814e-2866e60a1b12-kube-api-access-8zzff\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.192898 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-config-volume\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.193120 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5a20281-310c-49b8-814e-2866e60a1b12-cert\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.193120 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192931    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.193120 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-tmp-dir\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.193120 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.192978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtxzc\" (UniqueName: \"kubernetes.io/projected/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-kube-api-access-mtxzc\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.193335 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:32.193235    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:32.193335 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:32.193309    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:53:32.693287798 +0000 UTC m=+35.666329956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:32.193596 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.193566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-tmp-dir\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.193729 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.193599    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-config-volume\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.197859 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.197829    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5a20281-310c-49b8-814e-2866e60a1b12-cert\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.204147 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.204117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zzff\" (UniqueName: \"kubernetes.io/projected/f5a20281-310c-49b8-814e-2866e60a1b12-kube-api-access-8zzff\") pod \"ingress-canary-fnhx4\" (UID: \"f5a20281-310c-49b8-814e-2866e60a1b12\") " pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.206743 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.206716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtxzc\" (UniqueName: \"kubernetes.io/projected/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-kube-api-access-mtxzc\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.255892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.255854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fnhx4"
Jul 29 17:53:32.580931 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.580847    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:53:32.584003 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.583973    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 17:53:32.584131 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.583981    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkd97\""
Jul 29 17:53:32.697998 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.697955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:32.698212 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:32.698130    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:32.698281 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:32.698238    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:53:33.698216619 +0000 UTC m=+36.671258777 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:32.976227 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:32.975967    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fnhx4"]
Jul 29 17:53:32.979501 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:53:32.979471    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a20281_310c_49b8_814e_2866e60a1b12.slice/crio-905bd5beb9f088d53d4441c636360e4998c573617eabd837832884824e2a13e1 WatchSource:0}: Error finding container 905bd5beb9f088d53d4441c636360e4998c573617eabd837832884824e2a13e1: Status 404 returned error can't find the container with id 905bd5beb9f088d53d4441c636360e4998c573617eabd837832884824e2a13e1
Jul 29 17:53:33.580152 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.580117    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:53:33.580388 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.580354    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:53:33.583078 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.583049    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 17:53:33.584345 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.584318    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 17:53:33.584479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.584385    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmgk6\""
Jul 29 17:53:33.584479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.584329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 17:53:33.705336 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.705295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:33.705528 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:33.705451    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:33.705588 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:33.705528    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:53:35.705505506 +0000 UTC m=+38.678547688 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:33.867781 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.867740    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="97553cc748f0d51ca2ee8d7dc103f725f17f5f5ec7825623aefe745c131e2130" exitCode=0
Jul 29 17:53:33.867987 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.867825    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"97553cc748f0d51ca2ee8d7dc103f725f17f5f5ec7825623aefe745c131e2130"}
Jul 29 17:53:33.869163 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:33.869128    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnhx4" event={"ID":"f5a20281-310c-49b8-814e-2866e60a1b12","Type":"ContainerStarted","Data":"905bd5beb9f088d53d4441c636360e4998c573617eabd837832884824e2a13e1"}
Jul 29 17:53:34.875417 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:34.875380    2563 generic.go:356] "Generic (PLEG): container finished" podID="b68cc3df-89a0-43b1-89e4-0b63d7affa7e" containerID="a98061b3026af1ab159247f9f939a5403323eb03bae6fdf710614990c015c834" exitCode=0
Jul 29 17:53:34.875851 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:34.875443    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerDied","Data":"a98061b3026af1ab159247f9f939a5403323eb03bae6fdf710614990c015c834"}
Jul 29 17:53:35.723332 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:35.723017    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:35.723506 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:35.723177    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:35.723506 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:35.723403    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:53:39.72338626 +0000 UTC m=+42.696428429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:35.880992 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:35.880936    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" event={"ID":"b68cc3df-89a0-43b1-89e4-0b63d7affa7e","Type":"ContainerStarted","Data":"47b773d836f7c9f9592e77b498fcff998622bb3bbf5fc7663f50845630651d31"}
Jul 29 17:53:35.882422 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:35.882399    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fnhx4" event={"ID":"f5a20281-310c-49b8-814e-2866e60a1b12","Type":"ContainerStarted","Data":"c9f8d3a5f1aefa4cae5cd9aa09e9c57547ef4690dd55018d29cffb9b35dfff8d"}
Jul 29 17:53:35.907294 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:35.907243    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mdjn9" podStartSLOduration=8.376198784 podStartE2EDuration="38.907224358s" totalImagesPullingTime="30.531025574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:35.906057687 +0000 UTC m=+38.879099867" watchObservedRunningTime="2026-07-29 17:53:35.907224358 +0000 UTC m=+38.880266534"
Jul 29 17:53:35.927876 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:35.927822    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fnhx4" podStartSLOduration=2.599562625 podStartE2EDuration="4.927804911s" totalImagesPullingTime="2.328242286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:35.927382123 +0000 UTC m=+38.900424304" watchObservedRunningTime="2026-07-29 17:53:35.927804911 +0000 UTC m=+38.900847091"
Jul 29 17:53:36.142050 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:36.141996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:36.206982 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:36.206953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:36.992558 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:36.992513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:37.057702 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:37.057665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:39.752314 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:39.752268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:39.752693 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:39.752389    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:39.752693 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:39.752442    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:53:47.752427899 +0000 UTC m=+50.725470058 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:47.813693 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:47.813651    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:53:47.814162 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:47.813839    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 17:53:47.814162 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:47.813905    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls podName:5dedd0eb-7f05-4ffb-b9f2-610dd31224ee nodeName:}" failed. No retries permitted until 2026-07-29 17:54:03.813888995 +0000 UTC m=+66.786931152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls") pod "dns-default-k4ln6" (UID: "5dedd0eb-7f05-4ffb-b9f2-610dd31224ee") : secret "dns-default-metrics-tls" not found
Jul 29 17:53:50.311431 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.311394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"]
Jul 29 17:53:50.324466 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.324428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"
Jul 29 17:53:50.325653 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.325620    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"]
Jul 29 17:53:50.327348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.327313    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.327506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.327357    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.328383 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.328357    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bkhr4\""
Jul 29 17:53:50.333949 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.333929    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqt4\" (UniqueName: \"kubernetes.io/projected/bd1a6448-7a11-410f-8f59-86d5241b9b15-kube-api-access-xgqt4\") pod \"volume-data-source-validator-549c6d54cf-95krj\" (UID: \"bd1a6448-7a11-410f-8f59-86d5241b9b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"
Jul 29 17:53:50.413018 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.412984    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"]
Jul 29 17:53:50.434710 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.434674    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ds9rb"]
Jul 29 17:53:50.434938 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.434831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.435300 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.434955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqt4\" (UniqueName: \"kubernetes.io/projected/bd1a6448-7a11-410f-8f59-86d5241b9b15-kube-api-access-xgqt4\") pod \"volume-data-source-validator-549c6d54cf-95krj\" (UID: \"bd1a6448-7a11-410f-8f59-86d5241b9b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"
Jul 29 17:53:50.439309 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.439285    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 17:53:50.439309 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.439305    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.439653 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.439314    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 17:53:50.439653 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.439358    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.439653 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.439453    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6mnfn\""
Jul 29 17:53:50.458859 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.458830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqt4\" (UniqueName: \"kubernetes.io/projected/bd1a6448-7a11-410f-8f59-86d5241b9b15-kube-api-access-xgqt4\") pod \"volume-data-source-validator-549c6d54cf-95krj\" (UID: \"bd1a6448-7a11-410f-8f59-86d5241b9b15\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"
Jul 29 17:53:50.459036 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.459019    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wv2wc"]
Jul 29 17:53:50.459138 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.459126    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.462455 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.462423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 17:53:50.462455 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.462444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 17:53:50.462855 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.462834    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-n26rl\""
Jul 29 17:53:50.463182 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.463164    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.463699 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.463682    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.477625 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.475965    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 17:53:50.483143 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.483117    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wv2wc"]
Jul 29 17:53:50.483143 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.483150    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"]
Jul 29 17:53:50.483363 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.483164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ds9rb"]
Jul 29 17:53:50.483363 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.483179    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:53:50.483363 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.483260    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.486955 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.486937    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 17:53:50.487509 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.487484    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 17:53:50.487509 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.487501    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 17:53:50.487659 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.487556    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 17:53:50.487779 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.487765    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-tgl86\""
Jul 29 17:53:50.501207 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.501165    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:53:50.501332 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.501290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.509571 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.509552    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v4qcg\""
Jul 29 17:53:50.510748 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.510731    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 17:53:50.511782 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.511766    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 17:53:50.511964 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.511948    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 17:53:50.512166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.512154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 17:53:50.521801 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.521773    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"]
Jul 29 17:53:50.536680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.536680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca36fce4-4d1c-4b06-95e1-8762ffcad202-serving-cert\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536732    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536789    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-service-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsvjx\" (UniqueName: \"kubernetes.io/projected/ca36fce4-4d1c-4b06-95e1-8762ffcad202-kube-api-access-jsvjx\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr4jm\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.536916 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klkbr\" (UniqueName: \"kubernetes.io/projected/50363e97-efce-44d6-abff-163d52b45591-kube-api-access-klkbr\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-trusted-ca\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536966    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-tmp\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.536989    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpq49\" (UniqueName: \"kubernetes.io/projected/e26d40b4-f683-4f0e-8247-07abe58d2a7c-kube-api-access-jpq49\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537019    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537021    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e26d40b4-f683-4f0e-8247-07abe58d2a7c-serving-cert\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537090    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537115    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50363e97-efce-44d6-abff-163d52b45591-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537148    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.537166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537165    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-snapshots\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.537510 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-config\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.537510 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.537510 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.537264    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.543409 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.543378    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"]
Jul 29 17:53:50.543587 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.543497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"
Jul 29 17:53:50.549524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.549501    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hr7mh\""
Jul 29 17:53:50.634608 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.634571    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"
Jul 29 17:53:50.637857 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.637831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-service-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.637939 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.637866    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsvjx\" (UniqueName: \"kubernetes.io/projected/ca36fce4-4d1c-4b06-95e1-8762ffcad202-kube-api-access-jsvjx\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.637939 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.637888    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638050 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638022    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr4jm\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638085 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klkbr\" (UniqueName: \"kubernetes.io/projected/50363e97-efce-44d6-abff-163d52b45591-kube-api-access-klkbr\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.638144 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638130    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638186 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638160    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-trusted-ca\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.638270 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638210    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-tmp\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.638270 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpq49\" (UniqueName: \"kubernetes.io/projected/e26d40b4-f683-4f0e-8247-07abe58d2a7c-kube-api-access-jpq49\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.638270 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638257    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638270 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e26d40b4-f683-4f0e-8247-07abe58d2a7c-serving-cert\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638319    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50363e97-efce-44d6-abff-163d52b45591-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638372    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8979\" (UniqueName: \"kubernetes.io/projected/dd2d8680-8c83-4c36-9076-b944330b23eb-kube-api-access-q8979\") pod \"network-check-source-7d88cb55d8-nwh74\" (UID: \"dd2d8680-8c83-4c36-9076-b944330b23eb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-snapshots\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.638497 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638456    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-config\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-service-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638591    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca36fce4-4d1c-4b06-95e1-8762ffcad202-serving-cert\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:50.638734    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:50.638774 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:50.638752    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d68c5b547-drpdb: secret "image-registry-tls" not found
Jul 29 17:53:50.639252 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:50.638810    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls podName:0a85d982-e23e-4a54-92b5-ea6e98721b8c nodeName:}" failed. No retries permitted until 2026-07-29 17:53:51.138789665 +0000 UTC m=+54.111831831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls") pod "image-registry-5d68c5b547-drpdb" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c") : secret "image-registry-tls" not found
Jul 29 17:53:50.639252 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.638867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.639252 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639047    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-tmp\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.639252 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-trusted-ca\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.639476 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639256    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/50363e97-efce-44d6-abff-163d52b45591-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.639611 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639586    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/ca36fce4-4d1c-4b06-95e1-8762ffcad202-snapshots\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.639752 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639727    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e26d40b4-f683-4f0e-8247-07abe58d2a7c-config\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.639832 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:50.639817    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:50.639894 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:50.639885    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls podName:50363e97-efce-44d6-abff-163d52b45591 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:51.139867581 +0000 UTC m=+54.112909741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mdnts" (UID: "50363e97-efce-44d6-abff-163d52b45591") : secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:50.639959 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.639931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca36fce4-4d1c-4b06-95e1-8762ffcad202-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.641426 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.641405    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.641426 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.641416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e26d40b4-f683-4f0e-8247-07abe58d2a7c-serving-cert\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.641555 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.641429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.641555 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.641538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ca36fce4-4d1c-4b06-95e1-8762ffcad202-serving-cert\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.641895 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.641877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.649981 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.649942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpq49\" (UniqueName: \"kubernetes.io/projected/e26d40b4-f683-4f0e-8247-07abe58d2a7c-kube-api-access-jpq49\") pod \"console-operator-584dcb6b54-ds9rb\" (UID: \"e26d40b4-f683-4f0e-8247-07abe58d2a7c\") " pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.650324 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.650291    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.650423 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.650400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr4jm\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:50.650521 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.650429    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsvjx\" (UniqueName: \"kubernetes.io/projected/ca36fce4-4d1c-4b06-95e1-8762ffcad202-kube-api-access-jsvjx\") pod \"insights-operator-5885fdb759-wv2wc\" (UID: \"ca36fce4-4d1c-4b06-95e1-8762ffcad202\") " pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.650663 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.650644    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klkbr\" (UniqueName: \"kubernetes.io/projected/50363e97-efce-44d6-abff-163d52b45591-kube-api-access-klkbr\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:50.683330 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.683301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:50.739746 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.739715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8979\" (UniqueName: \"kubernetes.io/projected/dd2d8680-8c83-4c36-9076-b944330b23eb-kube-api-access-q8979\") pod \"network-check-source-7d88cb55d8-nwh74\" (UID: \"dd2d8680-8c83-4c36-9076-b944330b23eb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"
Jul 29 17:53:50.742782 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.742750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:50.748089 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.748055    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8979\" (UniqueName: \"kubernetes.io/projected/dd2d8680-8c83-4c36-9076-b944330b23eb-kube-api-access-q8979\") pod \"network-check-source-7d88cb55d8-nwh74\" (UID: \"dd2d8680-8c83-4c36-9076-b944330b23eb\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"
Jul 29 17:53:50.772749 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.772713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:53:50.779816 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.779784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj"]
Jul 29 17:53:50.783570 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:53:50.783521    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1a6448_7a11_410f_8f59_86d5241b9b15.slice/crio-b37cdf776a15c21ef3e5a7ee19788a6520339a4554777f4d3206e5c48a4495eb WatchSource:0}: Error finding container b37cdf776a15c21ef3e5a7ee19788a6520339a4554777f4d3206e5c48a4495eb: Status 404 returned error can't find the container with id b37cdf776a15c21ef3e5a7ee19788a6520339a4554777f4d3206e5c48a4495eb
Jul 29 17:53:50.791266 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.791245    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-wv2wc"
Jul 29 17:53:50.852555 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.852229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"
Jul 29 17:53:50.923061 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.920057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj" event={"ID":"bd1a6448-7a11-410f-8f59-86d5241b9b15","Type":"ContainerStarted","Data":"b37cdf776a15c21ef3e5a7ee19788a6520339a4554777f4d3206e5c48a4495eb"}
Jul 29 17:53:50.958835 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.958799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-ds9rb"]
Jul 29 17:53:50.961913 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:53:50.961867    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26d40b4_f683_4f0e_8247_07abe58d2a7c.slice/crio-af8076e745ecc3da5a3190a95ae88e96e3f09c7ed739a227807d8fc72ccb02e7 WatchSource:0}: Error finding container af8076e745ecc3da5a3190a95ae88e96e3f09c7ed739a227807d8fc72ccb02e7: Status 404 returned error can't find the container with id af8076e745ecc3da5a3190a95ae88e96e3f09c7ed739a227807d8fc72ccb02e7
Jul 29 17:53:50.992608 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:50.992536    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-wv2wc"]
Jul 29 17:53:51.012164 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.012129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74"]
Jul 29 17:53:51.015040 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:53:51.015011    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2d8680_8c83_4c36_9076_b944330b23eb.slice/crio-7f615ccd41a81ed57951193c25dde0ce96688cc451b530ca4e8bcdd3ed6a6fed WatchSource:0}: Error finding container 7f615ccd41a81ed57951193c25dde0ce96688cc451b530ca4e8bcdd3ed6a6fed: Status 404 returned error can't find the container with id 7f615ccd41a81ed57951193c25dde0ce96688cc451b530ca4e8bcdd3ed6a6fed
Jul 29 17:53:51.144565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.144447    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:51.144565 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.144524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:51.144780 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:51.144600    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:51.144780 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:51.144621    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d68c5b547-drpdb: secret "image-registry-tls" not found
Jul 29 17:53:51.144780 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:51.144676    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls podName:0a85d982-e23e-4a54-92b5-ea6e98721b8c nodeName:}" failed. No retries permitted until 2026-07-29 17:53:52.14466028 +0000 UTC m=+55.117702438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls") pod "image-registry-5d68c5b547-drpdb" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c") : secret "image-registry-tls" not found
Jul 29 17:53:51.144780 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:51.144681    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:51.144780 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:51.144734    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls podName:50363e97-efce-44d6-abff-163d52b45591 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:52.144720518 +0000 UTC m=+55.117762676 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mdnts" (UID: "50363e97-efce-44d6-abff-163d52b45591") : secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:51.462158 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.462070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:51.519893 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.519855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:51.926717 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.926601    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" event={"ID":"e26d40b4-f683-4f0e-8247-07abe58d2a7c","Type":"ContainerStarted","Data":"af8076e745ecc3da5a3190a95ae88e96e3f09c7ed739a227807d8fc72ccb02e7"}
Jul 29 17:53:51.928653 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.928583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wv2wc" event={"ID":"ca36fce4-4d1c-4b06-95e1-8762ffcad202","Type":"ContainerStarted","Data":"43fd22b2e80632c01c9e76cfe49f90dc780b5f2f7f1cf628e7545ea846b5aabf"}
Jul 29 17:53:51.930821 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:51.930777    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74" event={"ID":"dd2d8680-8c83-4c36-9076-b944330b23eb","Type":"ContainerStarted","Data":"7f615ccd41a81ed57951193c25dde0ce96688cc451b530ca4e8bcdd3ed6a6fed"}
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.154613    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.154687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:52.154868    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:52.154935    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls podName:50363e97-efce-44d6-abff-163d52b45591 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:54.154915053 +0000 UTC m=+57.127957213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mdnts" (UID: "50363e97-efce-44d6-abff-163d52b45591") : secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:52.155027    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:52.155049    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d68c5b547-drpdb: secret "image-registry-tls" not found
Jul 29 17:53:52.155347 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:52.155108    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls podName:0a85d982-e23e-4a54-92b5-ea6e98721b8c nodeName:}" failed. No retries permitted until 2026-07-29 17:53:54.155087937 +0000 UTC m=+57.128130111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls") pod "image-registry-5d68c5b547-drpdb" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c") : secret "image-registry-tls" not found
Jul 29 17:53:52.582574 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.582516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:52.684148 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.684071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:52.936073 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.936009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj" event={"ID":"bd1a6448-7a11-410f-8f59-86d5241b9b15","Type":"ContainerStarted","Data":"a8e12f113630878d1ea9501cbb65c2a94f0603aa8f08ab128c038dec466465a9"}
Jul 29 17:53:52.952679 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:52.952617    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-95krj" podStartSLOduration=1.150385624 podStartE2EDuration="2.95259783s" totalImagesPullingTime="1.802212206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:52.951598238 +0000 UTC m=+55.924640443" watchObservedRunningTime="2026-07-29 17:53:52.95259783 +0000 UTC m=+55.925640052"
Jul 29 17:53:53.078989 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:53.078952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:53.180138 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:53.180100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:53.571715 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:53.571672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:53.701733 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:53.701699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:54.174544 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.174507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:54.174722 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.174562    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:54.174722 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:54.174672    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:54.174722 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:54.174694    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d68c5b547-drpdb: secret "image-registry-tls" not found
Jul 29 17:53:54.174886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:54.174745    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls podName:0a85d982-e23e-4a54-92b5-ea6e98721b8c nodeName:}" failed. No retries permitted until 2026-07-29 17:53:58.174730138 +0000 UTC m=+61.147772296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls") pod "image-registry-5d68c5b547-drpdb" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c") : secret "image-registry-tls" not found
Jul 29 17:53:54.174886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:54.174675    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:54.174886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:54.174852    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls podName:50363e97-efce-44d6-abff-163d52b45591 nodeName:}" failed. No retries permitted until 2026-07-29 17:53:58.174834081 +0000 UTC m=+61.147876252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mdnts" (UID: "50363e97-efce-44d6-abff-163d52b45591") : secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:54.944156 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.944081    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/0.log"
Jul 29 17:53:54.944156 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.944121    2563 generic.go:356] "Generic (PLEG): container finished" podID="e26d40b4-f683-4f0e-8247-07abe58d2a7c" containerID="bea3cc740ecbfe120c015fc972fbc0f58cf6e96741d3e767189a4da911e0b749" exitCode=255
Jul 29 17:53:54.944649 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.944218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" event={"ID":"e26d40b4-f683-4f0e-8247-07abe58d2a7c","Type":"ContainerDied","Data":"bea3cc740ecbfe120c015fc972fbc0f58cf6e96741d3e767189a4da911e0b749"}
Jul 29 17:53:54.944649 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.944473    2563 scope.go:117] "RemoveContainer" containerID="bea3cc740ecbfe120c015fc972fbc0f58cf6e96741d3e767189a4da911e0b749"
Jul 29 17:53:54.945994 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.945957    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wv2wc" event={"ID":"ca36fce4-4d1c-4b06-95e1-8762ffcad202","Type":"ContainerStarted","Data":"6598fd2a80a0a6a3c08dc99a72d77db3de37393846d18026273979b99429e079"}
Jul 29 17:53:54.947845 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:54.947816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74" event={"ID":"dd2d8680-8c83-4c36-9076-b944330b23eb","Type":"ContainerStarted","Data":"4a597575e4b81d258e0e4b2c598bcd424f127bee476b83fadb09f1b41a47f4e9"}
Jul 29 17:53:55.010255 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.010172    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-wv2wc" podStartSLOduration=1.322897734 podStartE2EDuration="5.010152933s" totalImagesPullingTime="3.687255199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:55.009105683 +0000 UTC m=+57.982147861" watchObservedRunningTime="2026-07-29 17:53:55.010152933 +0000 UTC m=+57.983195111"
Jul 29 17:53:55.030647 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.030615    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"]
Jul 29 17:53:55.031306 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.031281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.032951 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.032935    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"
Jul 29 17:53:55.035840 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.035642    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 29 17:53:55.036980 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.036956    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-5jlbv\""
Jul 29 17:53:55.036980 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.036940    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-nwh74" podStartSLOduration=1.362773728 podStartE2EDuration="5.036918271s" totalImagesPullingTime="3.674144543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:55.036129769 +0000 UTC m=+58.009171946" watchObservedRunningTime="2026-07-29 17:53:55.036918271 +0000 UTC m=+58.009960453"
Jul 29 17:53:55.039313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.039250    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 29 17:53:55.052992 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.052960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"]
Jul 29 17:53:55.083930 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.083902    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s269h\" (UniqueName: \"kubernetes.io/projected/c6d24d6a-318d-4e68-9c59-7ed2caf68cc8-kube-api-access-s269h\") pod \"migrator-6865c9967-mp5nn\" (UID: \"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"
Jul 29 17:53:55.126903 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.126859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.185348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.185307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s269h\" (UniqueName: \"kubernetes.io/projected/c6d24d6a-318d-4e68-9c59-7ed2caf68cc8-kube-api-access-s269h\") pod \"migrator-6865c9967-mp5nn\" (UID: \"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"
Jul 29 17:53:55.194923 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.194850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s269h\" (UniqueName: \"kubernetes.io/projected/c6d24d6a-318d-4e68-9c59-7ed2caf68cc8-kube-api-access-s269h\") pod \"migrator-6865c9967-mp5nn\" (UID: \"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"
Jul 29 17:53:55.226967 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.226932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.343238 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.343175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"
Jul 29 17:53:55.479400 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.479367    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn"]
Jul 29 17:53:55.481831 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:53:55.481798    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6d24d6a_318d_4e68_9c59_7ed2caf68cc8.slice/crio-09f3fa24a2cbde6c9a6d4ecbdaa0eb673a6b848adec69c363ee57a0bbfb34cdc WatchSource:0}: Error finding container 09f3fa24a2cbde6c9a6d4ecbdaa0eb673a6b848adec69c363ee57a0bbfb34cdc: Status 404 returned error can't find the container with id 09f3fa24a2cbde6c9a6d4ecbdaa0eb673a6b848adec69c363ee57a0bbfb34cdc
Jul 29 17:53:55.533625 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.533588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.588881 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.588840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.808048 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.807955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.906336 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.906291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:55.953268 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.953231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn" event={"ID":"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8","Type":"ContainerStarted","Data":"09f3fa24a2cbde6c9a6d4ecbdaa0eb673a6b848adec69c363ee57a0bbfb34cdc"}
Jul 29 17:53:55.954892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.954872    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/1.log"
Jul 29 17:53:55.955300 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.955286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/0.log"
Jul 29 17:53:55.955384 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.955319    2563 generic.go:356] "Generic (PLEG): container finished" podID="e26d40b4-f683-4f0e-8247-07abe58d2a7c" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4" exitCode=255
Jul 29 17:53:55.955437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.955414    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" event={"ID":"e26d40b4-f683-4f0e-8247-07abe58d2a7c","Type":"ContainerDied","Data":"0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"}
Jul 29 17:53:55.955485 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.955461    2563 scope.go:117] "RemoveContainer" containerID="bea3cc740ecbfe120c015fc972fbc0f58cf6e96741d3e767189a4da911e0b749"
Jul 29 17:53:55.955693 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:55.955675    2563 scope.go:117] "RemoveContainer" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"
Jul 29 17:53:55.955898 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:55.955877    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ds9rb_openshift-console-operator(e26d40b4-f683-4f0e-8247-07abe58d2a7c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podUID="e26d40b4-f683-4f0e-8247-07abe58d2a7c"
Jul 29 17:53:56.160822 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.160526    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kq8qx"]
Jul 29 17:53:56.163014 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.162988    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.166323 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.166081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 17:53:56.166323 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.166116    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qzmlr\""
Jul 29 17:53:56.166569 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.166409    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 17:53:56.175683 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.175639    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kq8qx"]
Jul 29 17:53:56.195791 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.195758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4trj\" (UniqueName: \"kubernetes.io/projected/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-api-access-x4trj\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.196032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.195845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.196032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.195884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.196032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.195954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/145ec317-33a4-43fd-b3ec-949793c7bbfd-data-volume\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.196032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.196029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/145ec317-33a4-43fd-b3ec-949793c7bbfd-crio-socket\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.204508 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.204468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:56.268007 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.267970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:56.297528 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.297712 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297544    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.297712 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/145ec317-33a4-43fd-b3ec-949793c7bbfd-data-volume\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.297712 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.297624    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.297712 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297661    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/145ec317-33a4-43fd-b3ec-949793c7bbfd-crio-socket\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.297712 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.297714    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:56.797687605 +0000 UTC m=+59.770729764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.297982 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.297746    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.297982 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297763    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4trj\" (UniqueName: \"kubernetes.io/projected/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-api-access-x4trj\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.297982 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.297806    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:56.79778716 +0000 UTC m=+59.770829321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.297982 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.297751    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/145ec317-33a4-43fd-b3ec-949793c7bbfd-crio-socket\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.298224 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.298052    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/145ec317-33a4-43fd-b3ec-949793c7bbfd-data-volume\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.307923 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.307880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4trj\" (UniqueName: \"kubernetes.io/projected/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-api-access-x4trj\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.520350 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.520263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:56.801717 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.801622    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.801717 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.801677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:56.801907 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.801750    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.801907 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.801849    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.801907 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.801866    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.801844694 +0000 UTC m=+60.774886857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:56.801907 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.801905    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:57.801895753 +0000 UTC m=+60.774937910 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:56.960362 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.960331    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/1.log"
Jul 29 17:53:56.960730 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:56.960660    2563 scope.go:117] "RemoveContainer" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"
Jul 29 17:53:56.960828 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:56.960810    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ds9rb_openshift-console-operator(e26d40b4-f683-4f0e-8247-07abe58d2a7c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podUID="e26d40b4-f683-4f0e-8247-07abe58d2a7c"
Jul 29 17:53:57.440782 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.440748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:57.505007 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.504977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:57.811482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.811380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:57.811482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.811438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:57.811701 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:57.811509    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:57.811701 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:57.811581    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.811565842 +0000 UTC m=+62.784608004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:57.811701 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:57.811596    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:57.811701 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:57.811647    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:53:59.811631939 +0000 UTC m=+62.784674110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:57.867451 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.867414    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95zhz"
Jul 29 17:53:57.964976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.964926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn" event={"ID":"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8","Type":"ContainerStarted","Data":"bc324532d42da0aeacf1f0c28dc717147b2130553411788c35a6462bb309b64d"}
Jul 29 17:53:57.964976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:57.964981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn" event={"ID":"c6d24d6a-318d-4e68-9c59-7ed2caf68cc8","Type":"ContainerStarted","Data":"7837559c0a0a071ce5e32f2049c02e8c4671b742987260ac04f624c10bebccd7"}
Jul 29 17:53:58.030862 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.030831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:58.131490 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.131456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:58.214559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.214524    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:53:58.214742 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.214583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:53:58.214742 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:58.214689    2563 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 17:53:58.214742 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:58.214711    2563 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d68c5b547-drpdb: secret "image-registry-tls" not found
Jul 29 17:53:58.214886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:58.214753    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:58.214886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:58.214767    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls podName:0a85d982-e23e-4a54-92b5-ea6e98721b8c nodeName:}" failed. No retries permitted until 2026-07-29 17:54:06.214752424 +0000 UTC m=+69.187794585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls") pod "image-registry-5d68c5b547-drpdb" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c") : secret "image-registry-tls" not found
Jul 29 17:53:58.214886 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:58.214804    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls podName:50363e97-efce-44d6-abff-163d52b45591 nodeName:}" failed. No retries permitted until 2026-07-29 17:54:06.214788117 +0000 UTC m=+69.187830274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-mdnts" (UID: "50363e97-efce-44d6-abff-163d52b45591") : secret "cluster-monitoring-operator-tls" not found
Jul 29 17:53:58.341703 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.341674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vvn4_d3f168e0-407a-4adb-8d08-44483048aa7f/dns-node-resolver/0.log"
Jul 29 17:53:58.370788 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:58.370754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.192455 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.192416    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.332778 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.332750    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qcqs_405c33c3-79b1-4f64-8148-2189f0113caa/node-ca/0.log"
Jul 29 17:53:59.553152 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.553068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.651955 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.651918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.825683 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.825572    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:59.825683 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.825610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:53:59.825683 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.825667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.825683 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:59.825696    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:53:59.825968 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:59.825759    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:54:03.825743455 +0000 UTC m=+66.798785612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : configmap "kube-rbac-proxy" not found
Jul 29 17:53:59.825968 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:59.825759    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:59.825968 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:53:59.825791    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:54:03.825781854 +0000 UTC m=+66.798824038 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:53:59.926720 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.926690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:53:59.989900 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:53:59.989853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:00.132377 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.132344    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fnhx4_f5a20281-310c-49b8-814e-2866e60a1b12/serve-healthcheck-canary/0.log"
Jul 29 17:54:00.489477 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.489390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:00.533325 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.533297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mp5nn_c6d24d6a-318d-4e68-9c59-7ed2caf68cc8/migrator/0.log"
Jul 29 17:54:00.732551 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.732525    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mp5nn_c6d24d6a-318d-4e68-9c59-7ed2caf68cc8/graceful-termination/0.log"
Jul 29 17:54:00.773846 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.773767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:00.773846 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.773829    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:00.774171 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:00.774160    2563 scope.go:117] "RemoveContainer" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"
Jul 29 17:54:00.774349 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:00.774327    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-ds9rb_openshift-console-operator(e26d40b4-f683-4f0e-8247-07abe58d2a7c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podUID="e26d40b4-f683-4f0e-8247-07abe58d2a7c"
Jul 29 17:54:01.321525 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:01.321492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:01.598240 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:01.598167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:01.694839 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:01.694802    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:01.906699 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:01.906581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.039520 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.039455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.132273 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.132229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.243663 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.243568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:54:02.243663 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.243610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:54:02.246547 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.246516    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 17:54:02.246547 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.246536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 17:54:02.254240 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:02.254209    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 17:54:02.254395 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:02.254302    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs podName:68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064 nodeName:}" failed. No retries permitted until 2026-07-29 17:55:06.254278937 +0000 UTC m=+129.227321094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs") pod "network-metrics-daemon-2g4rv" (UID: "68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064") : secret "metrics-daemon-secret" not found
Jul 29 17:54:02.256437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.256417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2dfe09fd-e275-4e17-9c9f-98a76e8f2936-original-pull-secret\") pod \"global-pull-secret-syncer-dtp7s\" (UID: \"2dfe09fd-e275-4e17-9c9f-98a76e8f2936\") " pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:54:02.398628 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.398588    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dtp7s"
Jul 29 17:54:02.446984 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.445923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:54:02.449741 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.449709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwrml\" (UniqueName: \"kubernetes.io/projected/b17b2915-7587-4191-a44e-f1f3f761b033-kube-api-access-cwrml\") pod \"network-check-target-hnzzd\" (UID: \"b17b2915-7587-4191-a44e-f1f3f761b033\") " pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:54:02.512600 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.512531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.538631 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.538548    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-mp5nn" podStartSLOduration=5.959881967 podStartE2EDuration="7.538528619s" totalImagesPullingTime="1.578646652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:53:57.987318408 +0000 UTC m=+60.960360586" watchObservedRunningTime="2026-07-29 17:54:02.538528619 +0000 UTC m=+65.511570801"
Jul 29 17:54:02.539699 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.539674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dtp7s"]
Jul 29 17:54:02.543501 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:02.543476    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dfe09fd_e275_4e17_9c9f_98a76e8f2936.slice/crio-02accc3b60c0789f4e985898a00145e99558f0da97bd2c8fcc133d8f0ed25ebc WatchSource:0}: Error finding container 02accc3b60c0789f4e985898a00145e99558f0da97bd2c8fcc133d8f0ed25ebc: Status 404 returned error can't find the container with id 02accc3b60c0789f4e985898a00145e99558f0da97bd2c8fcc133d8f0ed25ebc
Jul 29 17:54:02.695264 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.695231    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fmgk6\""
Jul 29 17:54:02.702500 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.702472    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:54:02.794737 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.794703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.826930 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.826904    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hnzzd"]
Jul 29 17:54:02.829010 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:02.828982    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17b2915_7587_4191_a44e_f1f3f761b033.slice/crio-9940eddfdbe0015d235e58ad67600ab55fa382ade3b400a6baa95158835f2566 WatchSource:0}: Error finding container 9940eddfdbe0015d235e58ad67600ab55fa382ade3b400a6baa95158835f2566: Status 404 returned error can't find the container with id 9940eddfdbe0015d235e58ad67600ab55fa382ade3b400a6baa95158835f2566
Jul 29 17:54:02.895853 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.895813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:02.986926 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.986856    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtp7s" event={"ID":"2dfe09fd-e275-4e17-9c9f-98a76e8f2936","Type":"ContainerStarted","Data":"02accc3b60c0789f4e985898a00145e99558f0da97bd2c8fcc133d8f0ed25ebc"}
Jul 29 17:54:02.988541 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.988508    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnzzd" event={"ID":"b17b2915-7587-4191-a44e-f1f3f761b033","Type":"ContainerStarted","Data":"8d804b62a8e0bb0b081be2f031e26f602fb74d9132c95f46803657fc5883857a"}
Jul 29 17:54:02.988674 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.988556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hnzzd" event={"ID":"b17b2915-7587-4191-a44e-f1f3f761b033","Type":"ContainerStarted","Data":"9940eddfdbe0015d235e58ad67600ab55fa382ade3b400a6baa95158835f2566"}
Jul 29 17:54:02.988753 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:02.988712    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:54:03.007886 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.007828    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hnzzd" podStartSLOduration=66.007808728 podStartE2EDuration="1m6.007808728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:03.005819909 +0000 UTC m=+65.978862109" watchObservedRunningTime="2026-07-29 17:54:03.007808728 +0000 UTC m=+65.980850906"
Jul 29 17:54:03.092672 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.092632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:03.490707 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.490630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:03.590908 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.590864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:03.691583 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.691543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:03.857397 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.857361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.857406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.857444    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:03.857516    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:03.857597    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:54:11.857575799 +0000 UTC m=+74.830617958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : configmap "kube-rbac-proxy" not found
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:03.857612    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 17:54:03.857877 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:03.857674    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls podName:145ec317-33a4-43fd-b3ec-949793c7bbfd nodeName:}" failed. No retries permitted until 2026-07-29 17:54:11.857656742 +0000 UTC m=+74.830698900 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kq8qx" (UID: "145ec317-33a4-43fd-b3ec-949793c7bbfd") : secret "insights-runtime-extractor-tls" not found
Jul 29 17:54:03.860183 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:03.860158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5dedd0eb-7f05-4ffb-b9f2-610dd31224ee-metrics-tls\") pod \"dns-default-k4ln6\" (UID: \"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee\") " pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:54:04.052340 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.052302    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pzsbz\""
Jul 29 17:54:04.059600 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.059564    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:54:04.089380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.089269    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:04.226076 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.226041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-k4ln6"]
Jul 29 17:54:04.241720 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:04.241677    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dedd0eb_7f05_4ffb_b9f2_610dd31224ee.slice/crio-6149cb054d19ff6b1a0493a0761eadcb80bfbe1d522c2a14c95927061b088188 WatchSource:0}: Error finding container 6149cb054d19ff6b1a0493a0761eadcb80bfbe1d522c2a14c95927061b088188: Status 404 returned error can't find the container with id 6149cb054d19ff6b1a0493a0761eadcb80bfbe1d522c2a14c95927061b088188
Jul 29 17:54:04.692760 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.692723    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:04.997430 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:04.997339    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4ln6" event={"ID":"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee","Type":"ContainerStarted","Data":"6149cb054d19ff6b1a0493a0761eadcb80bfbe1d522c2a14c95927061b088188"}
Jul 29 17:54:05.112637 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:05.112594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:05.482125 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:05.482095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:05.537068 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:05.537018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:05.685077 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:05.685042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:06.114837 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.114748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:06.280880 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.280846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:06.281045 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.280893    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:54:06.283290 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.283261    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"image-registry-5d68c5b547-drpdb\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") " pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:06.283416 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.283394    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/50363e97-efce-44d6-abff-163d52b45591-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-mdnts\" (UID: \"50363e97-efce-44d6-abff-163d52b45591\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:54:06.347207 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.347160    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6mnfn\""
Jul 29 17:54:06.354912 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.354882    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"
Jul 29 17:54:06.412790 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.412760    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-v4qcg\""
Jul 29 17:54:06.420228 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.420183    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:06.894985 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.894792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:06.906947 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.906893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:54:06.912356 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:06.912321    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a85d982_e23e_4a54_92b5_ea6e98721b8c.slice/crio-d1feba0520b8e098c49baa947fbce8eaff037e5e30f16c53e529ca5be44a14fb WatchSource:0}: Error finding container d1feba0520b8e098c49baa947fbce8eaff037e5e30f16c53e529ca5be44a14fb: Status 404 returned error can't find the container with id d1feba0520b8e098c49baa947fbce8eaff037e5e30f16c53e529ca5be44a14fb
Jul 29 17:54:06.922111 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:06.922082    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts"]
Jul 29 17:54:06.926232 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:06.926188    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50363e97_efce_44d6_abff_163d52b45591.slice/crio-5d3eaa82880df0f9d031d3b91de612a9579b1ec5d873600c1fa94884cf46c5eb WatchSource:0}: Error finding container 5d3eaa82880df0f9d031d3b91de612a9579b1ec5d873600c1fa94884cf46c5eb: Status 404 returned error can't find the container with id 5d3eaa82880df0f9d031d3b91de612a9579b1ec5d873600c1fa94884cf46c5eb
Jul 29 17:54:07.007977 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.007873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4ln6" event={"ID":"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee","Type":"ContainerStarted","Data":"aafbb465f75803ceea39ca3bd1e02d4886dd50bdcaa09f1dd4e76f20aa00f4ca"}
Jul 29 17:54:07.007977 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.007945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-k4ln6" event={"ID":"5dedd0eb-7f05-4ffb-b9f2-610dd31224ee","Type":"ContainerStarted","Data":"215023327c61a6267c9de6d39e4390a222fff9d8cdf492a490b75467ae427e6c"}
Jul 29 17:54:07.008226 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.008000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:54:07.009397 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.009371    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dtp7s" event={"ID":"2dfe09fd-e275-4e17-9c9f-98a76e8f2936","Type":"ContainerStarted","Data":"95889637c941f548e16022777f4193302a29ddd93d28dad0c0a732cd055c0e81"}
Jul 29 17:54:07.011232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.011171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" event={"ID":"0a85d982-e23e-4a54-92b5-ea6e98721b8c","Type":"ContainerStarted","Data":"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"}
Jul 29 17:54:07.011405 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.011238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" event={"ID":"0a85d982-e23e-4a54-92b5-ea6e98721b8c","Type":"ContainerStarted","Data":"d1feba0520b8e098c49baa947fbce8eaff037e5e30f16c53e529ca5be44a14fb"}
Jul 29 17:54:07.011405 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.011270    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:07.012472 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.012448    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts" event={"ID":"50363e97-efce-44d6-abff-163d52b45591","Type":"ContainerStarted","Data":"5d3eaa82880df0f9d031d3b91de612a9579b1ec5d873600c1fa94884cf46c5eb"}
Jul 29 17:54:07.027772 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.027710    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-k4ln6" podStartSLOduration=33.524341654 podStartE2EDuration="36.027692338s" totalImagesPullingTime="2.503350684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:07.02601348 +0000 UTC m=+69.999055658" watchObservedRunningTime="2026-07-29 17:54:07.027692338 +0000 UTC m=+70.000734516"
Jul 29 17:54:07.048729 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.048663    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" podStartSLOduration=17.048646003 podStartE2EDuration="17.048646003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:07.048013206 +0000 UTC m=+70.021055404" watchObservedRunningTime="2026-07-29 17:54:07.048646003 +0000 UTC m=+70.021688183"
Jul 29 17:54:07.070064 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.070005    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dtp7s" podStartSLOduration=65.867455194 podStartE2EDuration="1m10.069987005s" totalImagesPullingTime="4.202531811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:07.069732187 +0000 UTC m=+70.042774367" watchObservedRunningTime="2026-07-29 17:54:07.069987005 +0000 UTC m=+70.043029184"
Jul 29 17:54:07.126582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.126552    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:07.290537 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.290472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:07.740453 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:07.740419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:08.169697 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:08.169664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:08.289464 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:08.289419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:08.706576 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:08.706522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:09.009862 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.009774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:09.021861 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.021822    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts" event={"ID":"50363e97-efce-44d6-abff-163d52b45591","Type":"ContainerStarted","Data":"625d2154433be228550970e6b23b30b88d41b3b63dc571577529a4bf0735e3f6"}
Jul 29 17:54:09.042100 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.042043    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-mdnts" podStartSLOduration=17.609648907 podStartE2EDuration="19.042025692s" totalImagesPullingTime="1.432376785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:09.041468045 +0000 UTC m=+72.014510249" watchObservedRunningTime="2026-07-29 17:54:09.042025692 +0000 UTC m=+72.015067870"
Jul 29 17:54:09.110717 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.110679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:09.172598 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.172571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:09.288467 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.288380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:09.697977 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:09.697942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:10.042058 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:10.041975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:10.143491 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:10.143433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:10.294616 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:10.294520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:11.580752 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:11.580717    2563 scope.go:117] "RemoveContainer" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"
Jul 29 17:54:11.929642 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:11.929602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:11.929642 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:11.929649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:11.930152 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:11.930134    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/145ec317-33a4-43fd-b3ec-949793c7bbfd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:11.931973 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:11.931954    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/145ec317-33a4-43fd-b3ec-949793c7bbfd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kq8qx\" (UID: \"145ec317-33a4-43fd-b3ec-949793c7bbfd\") " pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:12.033236 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.033186    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 17:54:12.033634 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.033619    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/1.log"
Jul 29 17:54:12.033681 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.033655    2563 generic.go:356] "Generic (PLEG): container finished" podID="e26d40b4-f683-4f0e-8247-07abe58d2a7c" containerID="ee98e200c6b0bbcf9fcf38e0a41dc80ef59556b807cda117327fd974d926a12c" exitCode=255
Jul 29 17:54:12.033713 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.033684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" event={"ID":"e26d40b4-f683-4f0e-8247-07abe58d2a7c","Type":"ContainerDied","Data":"ee98e200c6b0bbcf9fcf38e0a41dc80ef59556b807cda117327fd974d926a12c"}
Jul 29 17:54:12.033745 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.033729    2563 scope.go:117] "RemoveContainer" containerID="0af1c36bbd0abcf16d915a32eee30060d90032c6d993b690e326410dfd2d71c4"
Jul 29 17:54:12.034130 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.034112    2563 scope.go:117] "RemoveContainer" containerID="ee98e200c6b0bbcf9fcf38e0a41dc80ef59556b807cda117327fd974d926a12c"
Jul 29 17:54:12.034317 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:12.034288    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-ds9rb_openshift-console-operator(e26d40b4-f683-4f0e-8247-07abe58d2a7c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podUID="e26d40b4-f683-4f0e-8247-07abe58d2a7c"
Jul 29 17:54:12.077759 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.077728    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qzmlr\""
Jul 29 17:54:12.085914 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.085884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kq8qx"
Jul 29 17:54:12.214356 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:12.214281    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kq8qx"]
Jul 29 17:54:12.217347 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:12.217320    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod145ec317_33a4_43fd_b3ec_949793c7bbfd.slice/crio-71c8b5029937fbf54be597a40437740f6afcfe806e28cac5ea8d61e7a84a47d7 WatchSource:0}: Error finding container 71c8b5029937fbf54be597a40437740f6afcfe806e28cac5ea8d61e7a84a47d7: Status 404 returned error can't find the container with id 71c8b5029937fbf54be597a40437740f6afcfe806e28cac5ea8d61e7a84a47d7
Jul 29 17:54:13.040337 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:13.040304    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 17:54:13.042152 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:13.042113    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kq8qx" event={"ID":"145ec317-33a4-43fd-b3ec-949793c7bbfd","Type":"ContainerStarted","Data":"71c8b5029937fbf54be597a40437740f6afcfe806e28cac5ea8d61e7a84a47d7"}
Jul 29 17:54:16.193000 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.192962    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"]
Jul 29 17:54:16.224338 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.224302    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"]
Jul 29 17:54:16.224926 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.224398    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.227875 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.227846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 17:54:16.228024 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.227915    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 17:54:16.228268 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.228151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 17:54:16.228592 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.228569    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"]
Jul 29 17:54:16.228691 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.228615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"]
Jul 29 17:54:16.228691 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.228635    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"]
Jul 29 17:54:16.228773 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.228690    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.229085 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.229062    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 17:54:16.231118 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.231071    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:16.231358 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.231326    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 29 17:54:16.231501 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.231472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-dm8bw\""
Jul 29 17:54:16.233528 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.233510    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hdqnm\""
Jul 29 17:54:16.233656 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.233611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 17:54:16.241703 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.241674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"]
Jul 29 17:54:16.247219 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.247164    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:54:16.330167 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.330126    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-979784cf9-xgfpz"]
Jul 29 17:54:16.340224 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.340164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.361455 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.361424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-979784cf9-xgfpz"]
Jul 29 17:54:16.366598 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31dc8fb0-7f66-46a5-88e8-330c0aa88922-tmp\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.366794 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.366794 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366695    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xmvh\" (UniqueName: \"kubernetes.io/projected/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-kube-api-access-9xmvh\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.366794 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366758    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/31dc8fb0-7f66-46a5-88e8-330c0aa88922-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.366794 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366777    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj5gh\" (UniqueName: \"kubernetes.io/projected/31dc8fb0-7f66-46a5-88e8-330c0aa88922-kube-api-access-dj5gh\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.367013 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.366836    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c9864fc-ad26-43fc-8340-b2b7ba524da4-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tz84f\" (UID: \"4c9864fc-ad26-43fc-8340-b2b7ba524da4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:16.367674 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.367637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:16.466396 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.466307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:16.467307 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467278    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c9864fc-ad26-43fc-8340-b2b7ba524da4-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tz84f\" (UID: \"4c9864fc-ad26-43fc-8340-b2b7ba524da4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:16.467408 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467326    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e0df1a9-fb11-466b-a957-c76aa7438a04-ca-trust-extracted\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467408 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-bound-sa-token\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-image-registry-private-configuration\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31dc8fb0-7f66-46a5-88e8-330c0aa88922-tmp\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.467524 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh6tr\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-kube-api-access-gh6tr\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467675 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-certificates\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467675 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.467675 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-tls\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467718    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xmvh\" (UniqueName: \"kubernetes.io/projected/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-kube-api-access-9xmvh\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.467787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/31dc8fb0-7f66-46a5-88e8-330c0aa88922-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.467787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj5gh\" (UniqueName: \"kubernetes.io/projected/31dc8fb0-7f66-46a5-88e8-330c0aa88922-kube-api-access-dj5gh\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.467915 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467814    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-trusted-ca\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467915 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467839    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-installation-pull-secrets\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.467915 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.467892    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/31dc8fb0-7f66-46a5-88e8-330c0aa88922-tmp\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.470602 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.470577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4c9864fc-ad26-43fc-8340-b2b7ba524da4-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-tz84f\" (UID: \"4c9864fc-ad26-43fc-8340-b2b7ba524da4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:16.470762 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.470687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.470762 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.470693    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/31dc8fb0-7f66-46a5-88e8-330c0aa88922-klusterlet-config\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.478552 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.478525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xmvh\" (UniqueName: \"kubernetes.io/projected/f83a56f2-d1fe-42dc-b0d0-4af02cf5499f-kube-api-access-9xmvh\") pod \"managed-serviceaccount-addon-agent-84f7c9776b-6l6ng\" (UID: \"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.480752 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.480726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj5gh\" (UniqueName: \"kubernetes.io/projected/31dc8fb0-7f66-46a5-88e8-330c0aa88922-kube-api-access-dj5gh\") pod \"klusterlet-addon-workmgr-6b9b65ff4-hjf8k\" (UID: \"31dc8fb0-7f66-46a5-88e8-330c0aa88922\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.538256 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.538218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:16.554574 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.554541    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"
Jul 29 17:54:16.560960 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.560930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:16.569325 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-trusted-ca\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569495 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-installation-pull-secrets\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569495 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e0df1a9-fb11-466b-a957-c76aa7438a04-ca-trust-extracted\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569623 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569505    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-bound-sa-token\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569623 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-image-registry-private-configuration\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569623 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569581    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh6tr\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-kube-api-access-gh6tr\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-certificates\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.569756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.569691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-tls\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.570302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.570268    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6e0df1a9-fb11-466b-a957-c76aa7438a04-ca-trust-extracted\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.570415 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.570333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-trusted-ca\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.570764 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.570702    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-certificates\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.572606 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.572578    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-image-registry-private-configuration\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.572731 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.572708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6e0df1a9-fb11-466b-a957-c76aa7438a04-installation-pull-secrets\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.572855 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.572766    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-registry-tls\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.582642 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.582570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh6tr\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-kube-api-access-gh6tr\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.582642 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.582569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6e0df1a9-fb11-466b-a957-c76aa7438a04-bound-sa-token\") pod \"image-registry-979784cf9-xgfpz\" (UID: \"6e0df1a9-fb11-466b-a957-c76aa7438a04\") " pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.649316 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.649149    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:16.787936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.787847    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:16.936778 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:16.936729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:17.019957 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:17.019934    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-k4ln6"
Jul 29 17:54:17.222111 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:17.222079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng"]
Jul 29 17:54:17.225172 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:17.225131    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf83a56f2_d1fe_42dc_b0d0_4af02cf5499f.slice/crio-e14e8ce101d458507875b307f0a9c9db4fa22b8fab0f7ab5a652e0a36a8b1560 WatchSource:0}: Error finding container e14e8ce101d458507875b307f0a9c9db4fa22b8fab0f7ab5a652e0a36a8b1560: Status 404 returned error can't find the container with id e14e8ce101d458507875b307f0a9c9db4fa22b8fab0f7ab5a652e0a36a8b1560
Jul 29 17:54:17.442025 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:17.442000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"]
Jul 29 17:54:17.444369 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:17.444338    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31dc8fb0_7f66_46a5_88e8_330c0aa88922.slice/crio-a502935d1f6a31919275889106363118db87329e7035691df276a16569cf1703 WatchSource:0}: Error finding container a502935d1f6a31919275889106363118db87329e7035691df276a16569cf1703: Status 404 returned error can't find the container with id a502935d1f6a31919275889106363118db87329e7035691df276a16569cf1703
Jul 29 17:54:17.448335 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:17.448316    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"]
Jul 29 17:54:17.450727 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:17.450699    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c9864fc_ad26_43fc_8340_b2b7ba524da4.slice/crio-e32ac90e215578fda532472979f11d1465f49c210faa0a2752de05d5a01c225c WatchSource:0}: Error finding container e32ac90e215578fda532472979f11d1465f49c210faa0a2752de05d5a01c225c: Status 404 returned error can't find the container with id e32ac90e215578fda532472979f11d1465f49c210faa0a2752de05d5a01c225c
Jul 29 17:54:17.454483 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:17.454462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-979784cf9-xgfpz"]
Jul 29 17:54:17.457173 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:17.457148    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e0df1a9_fb11_466b_a957_c76aa7438a04.slice/crio-f957bfd699e66a7c02e712dded4ad6bdc11ba4e5ca0fe17f1ef86b7ae841edc1 WatchSource:0}: Error finding container f957bfd699e66a7c02e712dded4ad6bdc11ba4e5ca0fe17f1ef86b7ae841edc1: Status 404 returned error can't find the container with id f957bfd699e66a7c02e712dded4ad6bdc11ba4e5ca0fe17f1ef86b7ae841edc1
Jul 29 17:54:18.072156 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.072037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f" event={"ID":"4c9864fc-ad26-43fc-8340-b2b7ba524da4","Type":"ContainerStarted","Data":"e32ac90e215578fda532472979f11d1465f49c210faa0a2752de05d5a01c225c"}
Jul 29 17:54:18.075748 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.075686    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng" event={"ID":"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f","Type":"ContainerStarted","Data":"e14e8ce101d458507875b307f0a9c9db4fa22b8fab0f7ab5a652e0a36a8b1560"}
Jul 29 17:54:18.078295 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.078183    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kq8qx" event={"ID":"145ec317-33a4-43fd-b3ec-949793c7bbfd","Type":"ContainerStarted","Data":"49c06d6d28cc4ea5faa12b3c8070eaddb11c030c2b098bb9cc5be6ed91c2ebd2"}
Jul 29 17:54:18.081745 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.081400    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-979784cf9-xgfpz" event={"ID":"6e0df1a9-fb11-466b-a957-c76aa7438a04","Type":"ContainerStarted","Data":"4467ac41a3e1e5554a7e2e622c32ef5553eb0f1681eebb674df8cdb5988d82e0"}
Jul 29 17:54:18.081745 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.081468    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-979784cf9-xgfpz" event={"ID":"6e0df1a9-fb11-466b-a957-c76aa7438a04","Type":"ContainerStarted","Data":"f957bfd699e66a7c02e712dded4ad6bdc11ba4e5ca0fe17f1ef86b7ae841edc1"}
Jul 29 17:54:18.081745 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.081526    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:18.083348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.083281    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k" event={"ID":"31dc8fb0-7f66-46a5-88e8-330c0aa88922","Type":"ContainerStarted","Data":"a502935d1f6a31919275889106363118db87329e7035691df276a16569cf1703"}
Jul 29 17:54:18.104754 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:18.104581    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-979784cf9-xgfpz" podStartSLOduration=2.104557898 podStartE2EDuration="2.104557898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:18.102890367 +0000 UTC m=+81.075932566" watchObservedRunningTime="2026-07-29 17:54:18.104557898 +0000 UTC m=+81.077600078"
Jul 29 17:54:19.093510 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.093472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f" event={"ID":"4c9864fc-ad26-43fc-8340-b2b7ba524da4","Type":"ContainerStarted","Data":"62a24b47586ac276120bc5ceb78dfd108cdfa67e2e9e38401c2cdd8f83936ee8"}
Jul 29 17:54:19.094184 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.093898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:19.101113 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.101048    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f"
Jul 29 17:54:19.114975 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.114316    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-tz84f" podStartSLOduration=1.8373883009999998 podStartE2EDuration="3.114293493s" totalImagesPullingTime="1.276905192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:19.112770007 +0000 UTC m=+82.085812177" watchObservedRunningTime="2026-07-29 17:54:19.114293493 +0000 UTC m=+82.087335669"
Jul 29 17:54:19.643939 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.643899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:19.699518 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.699478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:19.866338 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.866292    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:19.950729 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:19.950649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:20.106748 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:20.106713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:20.773052 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:20.773020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:20.773286 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:20.773079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:20.773483 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:20.773468    2563 scope.go:117] "RemoveContainer" containerID="ee98e200c6b0bbcf9fcf38e0a41dc80ef59556b807cda117327fd974d926a12c"
Jul 29 17:54:20.773689 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:20.773667    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-ds9rb_openshift-console-operator(e26d40b4-f683-4f0e-8247-07abe58d2a7c)\"" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podUID="e26d40b4-f683-4f0e-8247-07abe58d2a7c"
Jul 29 17:54:21.987376 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:21.987347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:22.088307 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:22.088270    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:24.116275 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.116233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kq8qx" event={"ID":"145ec317-33a4-43fd-b3ec-949793c7bbfd","Type":"ContainerStarted","Data":"6c7f612286e9eea78b9c4b2584d87b9fd5801ed099dbce56daaa93871e5040bc"}
Jul 29 17:54:24.118175 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.118138    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k" event={"ID":"31dc8fb0-7f66-46a5-88e8-330c0aa88922","Type":"ContainerStarted","Data":"d0b9ae72e5b34334b00a69e34ced504e86da852cad09bcd479700a1fa4f94ad3"}
Jul 29 17:54:24.118419 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.118362    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:24.120425 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.120350    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng" event={"ID":"f83a56f2-d1fe-42dc-b0d0-4af02cf5499f","Type":"ContainerStarted","Data":"0c05e4dd559297d5cd819d6a391c03765377696f4ffe811ff91f6f1e76e10f7a"}
Jul 29 17:54:24.120541 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.120488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k"
Jul 29 17:54:24.134859 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.134794    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6b9b65ff4-hjf8k" podStartSLOduration=2.09198315 podStartE2EDuration="8.134773483s" totalImagesPullingTime="6.042790333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:24.134230363 +0000 UTC m=+87.107272543" watchObservedRunningTime="2026-07-29 17:54:24.134773483 +0000 UTC m=+87.107815664"
Jul 29 17:54:24.166504 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:24.166445    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-84f7c9776b-6l6ng" podStartSLOduration=1.9472204450000001 podStartE2EDuration="8.166426299s" totalImagesPullingTime="6.219205854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:24.165817982 +0000 UTC m=+87.138860161" watchObservedRunningTime="2026-07-29 17:54:24.166426299 +0000 UTC m=+87.139468477"
Jul 29 17:54:26.151778 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:26.151744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:26.253320 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:26.253225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:26.255467 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:26.255438    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:26.352401 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:26.352368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.001569 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.001536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.107838 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.107798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.138290 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.138252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kq8qx" event={"ID":"145ec317-33a4-43fd-b3ec-949793c7bbfd","Type":"ContainerStarted","Data":"8af2dec4d78069f3b2cc95cc1c552d000811e181d5e687f634cfa68f6bccbe75"}
Jul 29 17:54:28.162588 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.162527    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kq8qx" podStartSLOduration=17.47619505 podStartE2EDuration="32.162503904s" totalImagesPullingTime="14.686308854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 17:53:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:28.161316647 +0000 UTC m=+91.134358825" watchObservedRunningTime="2026-07-29 17:54:28.162503904 +0000 UTC m=+91.135546084"
Jul 29 17:54:28.235231 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.235184    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.281684 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.281576    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nq7k4"]
Jul 29 17:54:28.308837 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.308803    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.311847 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.311817    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 17:54:28.311847 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.311839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 17:54:28.312054 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.311878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gr9c5\""
Jul 29 17:54:28.312054 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.312001    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 17:54:28.312264 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.312247    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 17:54:28.329310 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.329278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.427705 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.427673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.482501 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482456    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-metrics-client-ca\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482501 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbnzw\" (UniqueName: \"kubernetes.io/projected/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-kube-api-access-lbnzw\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482574    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-textfile\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482598    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-accelerators-collector-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482679    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-sys\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-root\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-tls\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482747 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482748    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-wtmp\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.482935 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.482818    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.583809 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.583809 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-metrics-client-ca\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.583809 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbnzw\" (UniqueName: \"kubernetes.io/projected/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-kube-api-access-lbnzw\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-textfile\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-accelerators-collector-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583965    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-sys\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.583989    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-root\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584013    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-tls\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584044    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-wtmp\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584418 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584185    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-sys\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584418 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-wtmp\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584418 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-root\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584569 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-textfile\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584569 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-metrics-client-ca\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.584743 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.584724    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-accelerators-collector-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.586515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.586494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.586967 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.586946    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-node-exporter-tls\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.596885 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.596850    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbnzw\" (UniqueName: \"kubernetes.io/projected/7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58-kube-api-access-lbnzw\") pod \"node-exporter-nq7k4\" (UID: \"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58\") " pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.598071 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.598040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:28.619225 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.619172    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nq7k4"
Jul 29 17:54:28.652265 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:28.652235    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ad998da_0e2d_4eb4_b1b3_49fda4ecfa58.slice/crio-116469dfd4b49885666559d9e6847dbfa437215dbeccc65787f2d271533deb17 WatchSource:0}: Error finding container 116469dfd4b49885666559d9e6847dbfa437215dbeccc65787f2d271533deb17: Status 404 returned error can't find the container with id 116469dfd4b49885666559d9e6847dbfa437215dbeccc65787f2d271533deb17
Jul 29 17:54:28.697541 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:28.697506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:29.141332 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:29.141291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:29.142463 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:29.142438    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nq7k4" event={"ID":"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58","Type":"ContainerStarted","Data":"116469dfd4b49885666559d9e6847dbfa437215dbeccc65787f2d271533deb17"}
Jul 29 17:54:29.241404 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:29.241368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:29.306556 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:29.306522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:29.654889 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:29.654838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:30.620649 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:30.620609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:30.722688 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:30.722637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:31.152957 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.152916    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58" containerID="6b6877c2b2036edc9575390e883b21c786f4aa66ab27d5b402c8dc7e8ed8283d" exitCode=0
Jul 29 17:54:31.153167 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.152989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nq7k4" event={"ID":"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58","Type":"ContainerDied","Data":"6b6877c2b2036edc9575390e883b21c786f4aa66ab27d5b402c8dc7e8ed8283d"}
Jul 29 17:54:31.193138 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.193110    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:31.259005 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.258974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:31.816811 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.816775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:31.874016 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:31.873974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:32.159094 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:32.159059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nq7k4" event={"ID":"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58","Type":"ContainerStarted","Data":"590e381f2ab97a4303d55f27e598544d16a92fea6ce7d3c0a143e28c88f01b06"}
Jul 29 17:54:32.159282 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:32.159111    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nq7k4" event={"ID":"7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58","Type":"ContainerStarted","Data":"1e46b15334ae8435735b6fc602581a15cdf8c634bfb7ab76f13927c7372d2aa5"}
Jul 29 17:54:32.179803 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:32.179743    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nq7k4" podStartSLOduration=2.463357933 podStartE2EDuration="4.179723453s" totalImagesPullingTime="1.617920526s" totalInitContainerRuntime="98.444994ms" isStatefulPod=true podCreationTimestamp="2026-07-29 17:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:32.177812348 +0000 UTC m=+95.150854528" watchObservedRunningTime="2026-07-29 17:54:32.179723453 +0000 UTC m=+95.152765633"
Jul 29 17:54:33.013952 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:33.013913    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:33.073445 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:33.073404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:33.995364 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:33.995331    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hnzzd"
Jul 29 17:54:34.488849 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:34.488817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:35.577336 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:35.577305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:35.580504 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:35.580482    2563 scope.go:117] "RemoveContainer" containerID="ee98e200c6b0bbcf9fcf38e0a41dc80ef59556b807cda117327fd974d926a12c"
Jul 29 17:54:35.668601 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:35.668563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:36.177515 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.177484    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 17:54:36.177720 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.177596    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" event={"ID":"e26d40b4-f683-4f0e-8247-07abe58d2a7c","Type":"ContainerStarted","Data":"6d2221198c4c9cbc6544b91f5a3cc89e1a578abe6783e23c487b9a81edecf784"}
Jul 29 17:54:36.177890 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.177864    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:36.194734 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.194672    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb" podStartSLOduration=42.478215348 podStartE2EDuration="46.194654888s" totalImagesPullingTime="3.71643954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:36.193557679 +0000 UTC m=+99.166599856" watchObservedRunningTime="2026-07-29 17:54:36.194654888 +0000 UTC m=+99.167697105"
Jul 29 17:54:36.651208 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.651165    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-ds9rb"
Jul 29 17:54:36.841805 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.841770    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-gzjtw"]
Jul 29 17:54:36.874542 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.874509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gzjtw"]
Jul 29 17:54:36.874708 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.874608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:36.877994 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.877964    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 17:54:36.877994 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.877990    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 17:54:36.878242 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.877999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:36.878242 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.878015    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-f7xdj\""
Jul 29 17:54:36.952888 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:36.952808    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:37.056464 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.056426    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4hcg\" (UniqueName: \"kubernetes.io/projected/ff0515aa-40f4-464b-8b4c-022889bdfe7e-kube-api-access-f4hcg\") pod \"downloads-7c97dc4555-gzjtw\" (UID: \"ff0515aa-40f4-464b-8b4c-022889bdfe7e\") " pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:37.137894 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.137858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:37.157824 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.157788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4hcg\" (UniqueName: \"kubernetes.io/projected/ff0515aa-40f4-464b-8b4c-022889bdfe7e-kube-api-access-f4hcg\") pod \"downloads-7c97dc4555-gzjtw\" (UID: \"ff0515aa-40f4-464b-8b4c-022889bdfe7e\") " pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:37.168007 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.167973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4hcg\" (UniqueName: \"kubernetes.io/projected/ff0515aa-40f4-464b-8b4c-022889bdfe7e-kube-api-access-f4hcg\") pod \"downloads-7c97dc4555-gzjtw\" (UID: \"ff0515aa-40f4-464b-8b4c-022889bdfe7e\") " pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:37.186004 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.185974    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:37.350978 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.350955    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-gzjtw"]
Jul 29 17:54:37.353467 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:37.353435    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0515aa_40f4_464b_8b4c_022889bdfe7e.slice/crio-031fef2e7f9f23e90105df847ad5ff656e47738260dcf6c7cf5354b61013db75 WatchSource:0}: Error finding container 031fef2e7f9f23e90105df847ad5ff656e47738260dcf6c7cf5354b61013db75: Status 404 returned error can't find the container with id 031fef2e7f9f23e90105df847ad5ff656e47738260dcf6c7cf5354b61013db75
Jul 29 17:54:37.521032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.520943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:37.621539 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.621507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:37.724694 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.724647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:37.825598 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:37.825485    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:38.133929 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.133894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:38.187433 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.187389    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gzjtw" event={"ID":"ff0515aa-40f4-464b-8b4c-022889bdfe7e","Type":"ContainerStarted","Data":"031fef2e7f9f23e90105df847ad5ff656e47738260dcf6c7cf5354b61013db75"}
Jul 29 17:54:38.235258 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.235221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:38.334717 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.334678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:38.854384 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.854345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:38.954891 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:38.954844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:39.099644 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:39.099613    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-979784cf9-xgfpz"
Jul 29 17:54:39.250391 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:39.250306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:39.353487 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:39.353432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:39.458652 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:39.458612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:40.872402 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:40.872361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:40.971930 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:40.971898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:41.267900 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.267801    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" podUID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" containerName="registry" containerID="cri-o://31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325" gracePeriod=30
Jul 29 17:54:41.528692 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.528617    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:41.600682 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600649    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600735    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600768    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600802    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600858    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.600892 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.601286 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.600917    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr4jm\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm\") pod \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\" (UID: \"0a85d982-e23e-4a54-92b5-ea6e98721b8c\") "
Jul 29 17:54:41.602178 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.601347    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:54:41.602313 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.602236    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:54:41.604090 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.604024    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:54:41.604241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.604102    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:54:41.604241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.604101    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:54:41.604241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.604220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm" (OuterVolumeSpecName: "kube-api-access-jr4jm") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "kube-api-access-jr4jm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:54:41.604488 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.604465    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:54:41.613018 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.612980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0a85d982-e23e-4a54-92b5-ea6e98721b8c" (UID: "0a85d982-e23e-4a54-92b5-ea6e98721b8c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 17:54:41.702133 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702092    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-image-registry-private-configuration\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702133 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702125    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-certificates\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702133 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702137    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a85d982-e23e-4a54-92b5-ea6e98721b8c-trusted-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702152    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a85d982-e23e-4a54-92b5-ea6e98721b8c-installation-pull-secrets\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702166    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-registry-tls\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702179    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-bound-sa-token\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702211    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr4jm\" (UniqueName: \"kubernetes.io/projected/0a85d982-e23e-4a54-92b5-ea6e98721b8c-kube-api-access-jr4jm\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:41.702380 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:41.702224    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a85d982-e23e-4a54-92b5-ea6e98721b8c-ca-trust-extracted\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:54:42.206649 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.206607    2563 generic.go:356] "Generic (PLEG): container finished" podID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" containerID="31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325" exitCode=0
Jul 29 17:54:42.207241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.206668    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb"
Jul 29 17:54:42.207241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.206694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" event={"ID":"0a85d982-e23e-4a54-92b5-ea6e98721b8c","Type":"ContainerDied","Data":"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"}
Jul 29 17:54:42.207241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.206740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d68c5b547-drpdb" event={"ID":"0a85d982-e23e-4a54-92b5-ea6e98721b8c","Type":"ContainerDied","Data":"d1feba0520b8e098c49baa947fbce8eaff037e5e30f16c53e529ca5be44a14fb"}
Jul 29 17:54:42.207241 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.206765    2563 scope.go:117] "RemoveContainer" containerID="31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"
Jul 29 17:54:42.217563 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.217540    2563 scope.go:117] "RemoveContainer" containerID="31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"
Jul 29 17:54:42.217960 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:54:42.217936    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325\": container with ID starting with 31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325 not found: ID does not exist" containerID="31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"
Jul 29 17:54:42.218068 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.217968    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325"} err="failed to get container status \"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325\": rpc error: code = NotFound desc = could not find container \"31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325\": container with ID starting with 31ccd84e2bd7df8af3f50e10f427163bbc8dcc182050b5a438c7724b0cc50325 not found: ID does not exist"
Jul 29 17:54:42.231283 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.231243    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:54:42.235362 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:42.235325    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d68c5b547-drpdb"]
Jul 29 17:54:43.587494 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:43.587450    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" path="/var/lib/kubelet/pods/0a85d982-e23e-4a54-92b5-ea6e98721b8c/volumes"
Jul 29 17:54:43.701361 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:43.701323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:43.801897 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:43.801866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:46.364076 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.364042    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:54:46.364506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.364419    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" containerName="registry"
Jul 29 17:54:46.364506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.364433    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" containerName="registry"
Jul 29 17:54:46.364506 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.364498    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a85d982-e23e-4a54-92b5-ea6e98721b8c" containerName="registry"
Jul 29 17:54:46.374062 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.374029    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.377011 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.376986    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 17:54:46.378264 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.378239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 17:54:46.378402 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.378239    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 17:54:46.378402 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.378288    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 17:54:46.378536 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.378518    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 17:54:46.378937 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.378759    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hx57z\""
Jul 29 17:54:46.380657 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.380629    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:54:46.446358 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446286    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.446358 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52nwd\" (UniqueName: \"kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.446582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446369    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.446582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.446582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.446582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.446504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.547849 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.547812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.547872    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.547903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.547960    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.547988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52nwd\" (UniqueName: \"kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.548023    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548719 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.548660    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.548719 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.548701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.549214 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.549177    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.551219 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.551174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.551385 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.551350    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.558125 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.558094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52nwd\" (UniqueName: \"kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd\") pod \"console-7bf7445545-tn9pz\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") " pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.686040 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.685955    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:54:46.846844 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:46.846815    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:54:51.746117 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:51.746074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:51.800493 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:51.800445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:51.979866 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:51.979829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:52.080345 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:52.080262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:53.823037 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:53.823001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:53.913412 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:53.913378    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:53.987309 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:53.987276    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8794b4d_a3ba_48f0_8fc3_d9d7663ecb05.slice/crio-74b0d81a7acaefc632084802fac66e69eac2b5bbae42c074e331fd389c8073bf WatchSource:0}: Error finding container 74b0d81a7acaefc632084802fac66e69eac2b5bbae42c074e331fd389c8073bf: Status 404 returned error can't find the container with id 74b0d81a7acaefc632084802fac66e69eac2b5bbae42c074e331fd389c8073bf
Jul 29 17:54:54.267102 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.267076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7445545-tn9pz" event={"ID":"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05","Type":"ContainerStarted","Data":"74b0d81a7acaefc632084802fac66e69eac2b5bbae42c074e331fd389c8073bf"}
Jul 29 17:54:54.744228 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.744035    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:54:54.764123 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.764084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:54:54.764318 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.764250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.774778 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.774611    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 17:54:54.826405 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826257    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826405 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqcv\" (UniqueName: \"kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826405 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826974 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826974 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826974 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826474    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.826974 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.826520    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.927692 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.927692 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqcv\" (UniqueName: \"kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.927692 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.928025 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.928025 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927775    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.928025 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.928025 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.927844    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.928769 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.928739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.929094 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.929020    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.929246 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.929234    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.929645 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.929623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.931460 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.931433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.931677 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.931589    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:54.939227 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:54.939174    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqcv\" (UniqueName: \"kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv\") pod \"console-7d9f587f6f-fnzn4\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") " pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:55.079780 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.079688    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:54:55.275284 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.275075    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-gzjtw" event={"ID":"ff0515aa-40f4-464b-8b4c-022889bdfe7e","Type":"ContainerStarted","Data":"3bdbd4311ca6da4b15ebc2b862e8003b88cfb9a73b7f25be7911fc143056e17c"}
Jul 29 17:54:55.275491 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.275429    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:55.283463 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.283403    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:54:55.286272 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.286247    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-gzjtw"
Jul 29 17:54:55.287792 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:54:55.287762    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91d0caa8_9c15_4aa1_9e2e_677b419edb77.slice/crio-46bd30448f83c32a686df547db08c90eb83a32c118ac2c4e1f2824f754afbd88 WatchSource:0}: Error finding container 46bd30448f83c32a686df547db08c90eb83a32c118ac2c4e1f2824f754afbd88: Status 404 returned error can't find the container with id 46bd30448f83c32a686df547db08c90eb83a32c118ac2c4e1f2824f754afbd88
Jul 29 17:54:55.300612 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.300543    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-gzjtw" podStartSLOduration=2.393071399 podStartE2EDuration="19.300521594s" totalImagesPullingTime="16.907450195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:55.297324861 +0000 UTC m=+118.270367046" watchObservedRunningTime="2026-07-29 17:54:55.300521594 +0000 UTC m=+118.273563774"
Jul 29 17:54:55.543183 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:55.543143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:56.283337 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:56.283257    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f587f6f-fnzn4" event={"ID":"91d0caa8-9c15-4aa1-9e2e-677b419edb77","Type":"ContainerStarted","Data":"46bd30448f83c32a686df547db08c90eb83a32c118ac2c4e1f2824f754afbd88"}
Jul 29 17:54:58.561169 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:58.561137    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:58.662563 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:58.662515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:58.728043 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:58.728003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:54:59.300463 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:59.300425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7445545-tn9pz" event={"ID":"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05","Type":"ContainerStarted","Data":"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"}
Jul 29 17:54:59.302317 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:59.302286    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f587f6f-fnzn4" event={"ID":"91d0caa8-9c15-4aa1-9e2e-677b419edb77","Type":"ContainerStarted","Data":"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"}
Jul 29 17:54:59.318862 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:59.318788    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bf7445545-tn9pz" podStartSLOduration=8.877001211 podStartE2EDuration="13.318767325s" totalImagesPullingTime="4.441766114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:59.317070785 +0000 UTC m=+122.290112977" watchObservedRunningTime="2026-07-29 17:54:59.318767325 +0000 UTC m=+122.291809504"
Jul 29 17:54:59.337609 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:54:59.337553    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d9f587f6f-fnzn4" podStartSLOduration=2.189127025 podStartE2EDuration="5.337536003s" totalImagesPullingTime="3.148408978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:54:59.33604509 +0000 UTC m=+122.309087272" watchObservedRunningTime="2026-07-29 17:54:59.337536003 +0000 UTC m=+122.310578183"
Jul 29 17:55:02.557051 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:02.557007    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:02.613863 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:02.613827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:03.789827 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:03.789791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:03.848930 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:03.848873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:04.968299 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:04.968263    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:05.080844 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:05.080797    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:55:05.081019 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:05.080893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:55:05.086045 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:05.086016    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:55:05.332141 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:05.332058    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:55:05.379782 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:05.379747    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:55:06.023826 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.023792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:06.099087 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.099055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:06.233148 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.233118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:06.281939 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.281844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:06.350607 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.350576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:55:06.352903 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.352880    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064-metrics-certs\") pod \"network-metrics-daemon-2g4rv\" (UID: \"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064\") " pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:55:06.494706 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.494672    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kkd97\""
Jul 29 17:55:06.502942 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.502916    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2g4rv"
Jul 29 17:55:06.687008 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.686974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:55:06.756573 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.756544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2g4rv"]
Jul 29 17:55:06.759484 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:55:06.759451    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b57c7c_b9c9_4b1d_83b3_d3dc6b2a5064.slice/crio-84b3f2f22a230ea3f68f148a14ceb267c99191af5e2cba38088a5bc095c75694 WatchSource:0}: Error finding container 84b3f2f22a230ea3f68f148a14ceb267c99191af5e2cba38088a5bc095c75694: Status 404 returned error can't find the container with id 84b3f2f22a230ea3f68f148a14ceb267c99191af5e2cba38088a5bc095c75694
Jul 29 17:55:06.976374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:06.976283    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:07.077649 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:07.077617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:07.337457 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:07.337364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2g4rv" event={"ID":"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064","Type":"ContainerStarted","Data":"84b3f2f22a230ea3f68f148a14ceb267c99191af5e2cba38088a5bc095c75694"}
Jul 29 17:55:08.343244 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:08.343205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2g4rv" event={"ID":"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064","Type":"ContainerStarted","Data":"ee1e92771c76c1bcdd9c935bd24bcb4f5d15ade93c826c3118390bc1911cd6c6"}
Jul 29 17:55:09.348783 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:09.348745    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2g4rv" event={"ID":"68b57c7c-b9c9-4b1d-83b3-d3dc6b2a5064","Type":"ContainerStarted","Data":"f046258cbd447402f7d81ff49b1c3b7c46989e2823a9daca7d74fbe0fc3c4965"}
Jul 29 17:55:09.364186 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:09.364125    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2g4rv" podStartSLOduration=130.923247298 podStartE2EDuration="2m12.364106685s" totalImagesPullingTime="1.440859387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:52:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:55:09.363997515 +0000 UTC m=+132.337039697" watchObservedRunningTime="2026-07-29 17:55:09.364106685 +0000 UTC m=+132.337148864"
Jul 29 17:55:09.470978 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:09.470944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:09.593160 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:09.593115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:11.356911 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:11.356874    2563 generic.go:356] "Generic (PLEG): container finished" podID="ca36fce4-4d1c-4b06-95e1-8762ffcad202" containerID="6598fd2a80a0a6a3c08dc99a72d77db3de37393846d18026273979b99429e079" exitCode=0
Jul 29 17:55:11.357317 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:11.356948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wv2wc" event={"ID":"ca36fce4-4d1c-4b06-95e1-8762ffcad202","Type":"ContainerDied","Data":"6598fd2a80a0a6a3c08dc99a72d77db3de37393846d18026273979b99429e079"}
Jul 29 17:55:11.357317 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:11.357314    2563 scope.go:117] "RemoveContainer" containerID="6598fd2a80a0a6a3c08dc99a72d77db3de37393846d18026273979b99429e079"
Jul 29 17:55:12.363733 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:12.363698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-wv2wc" event={"ID":"ca36fce4-4d1c-4b06-95e1-8762ffcad202","Type":"ContainerStarted","Data":"e3adbf43e8963b4fe49124676f7c399dcf49297b657ed870b8ec8550ab28c6f8"}
Jul 29 17:55:21.980977 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:21.980919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:22.080483 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:22.080452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:30.399236 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.399158    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bf7445545-tn9pz" podUID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" containerName="console" containerID="cri-o://c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057" gracePeriod=15
Jul 29 17:55:30.690757 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.690725    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:55:30.741487 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741450    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52nwd\" (UniqueName: \"kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.741659 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.741659 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741564    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.741659 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741621    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.741659 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.741851 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.741691    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config\") pod \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\" (UID: \"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05\") "
Jul 29 17:55:30.742060 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.742021    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:55:30.742180 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.742085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:55:30.742180 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.742130    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config" (OuterVolumeSpecName: "console-config") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:55:30.743896 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.743867    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd" (OuterVolumeSpecName: "kube-api-access-52nwd") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "kube-api-access-52nwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:55:30.744265 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.744244    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:55:30.744330 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.744262    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" (UID: "c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:55:30.842559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842511    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:30.842559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842547    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:30.842559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842560    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-oauth-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:30.842559 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842571    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-oauth-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:30.842880 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842583    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-console-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:30.842880 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:30.842595    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52nwd\" (UniqueName: \"kubernetes.io/projected/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05-kube-api-access-52nwd\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:55:31.441818 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.441779    2563 generic.go:356] "Generic (PLEG): container finished" podID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" containerID="c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057" exitCode=0
Jul 29 17:55:31.442280 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.441825    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bf7445545-tn9pz"
Jul 29 17:55:31.442280 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.441853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7445545-tn9pz" event={"ID":"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05","Type":"ContainerDied","Data":"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"}
Jul 29 17:55:31.442280 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.441924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bf7445545-tn9pz" event={"ID":"c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05","Type":"ContainerDied","Data":"74b0d81a7acaefc632084802fac66e69eac2b5bbae42c074e331fd389c8073bf"}
Jul 29 17:55:31.442280 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.441947    2563 scope.go:117] "RemoveContainer" containerID="c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"
Jul 29 17:55:31.451018 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.450999    2563 scope.go:117] "RemoveContainer" containerID="c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"
Jul 29 17:55:31.451371 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:55:31.451351    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057\": container with ID starting with c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057 not found: ID does not exist" containerID="c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"
Jul 29 17:55:31.451420 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.451381    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057"} err="failed to get container status \"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057\": rpc error: code = NotFound desc = could not find container \"c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057\": container with ID starting with c2169c49061dcfe0d5382a99abee40a8e8720ff4567ba85af5c837ef0ea43057 not found: ID does not exist"
Jul 29 17:55:31.465166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.465132    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:55:31.468186 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.468159    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bf7445545-tn9pz"]
Jul 29 17:55:31.585639 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:31.585603    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" path="/var/lib/kubelet/pods/c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05/volumes"
Jul 29 17:55:32.020627 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:32.020588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:32.179816 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:32.179757    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:35.904140 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:35.904076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:47.451477 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:47.451444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:48.107078 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:48.107039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:55.803421 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.802558    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:55:55.803421 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.802968    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" containerName="console"
Jul 29 17:55:55.803421 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.802985    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" containerName="console"
Jul 29 17:55:55.803421 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.803090    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8794b4d-a3ba-48f0-8fc3-d9d7663ecb05" containerName="console"
Jul 29 17:55:55.809994 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.806109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.819937 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.819908    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:55:55.899591 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.899560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:55.952232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fphcj\" (UniqueName: \"kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952351    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.952406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.952400    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:55.956762 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:55.956733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:56.021343 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.021278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:56.053067 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053029    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fphcj\" (UniqueName: \"kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053100    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053120    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053153    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053997 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053934    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.053997 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.053959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.054165 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.054028    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.055005 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.054974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.055774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.055754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.056106 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.056079    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.061439 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.061392    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fphcj\" (UniqueName: \"kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj\") pod \"console-77c4b8dcfc-h9xxn\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") " pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.120146 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.120104    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:55:56.260538 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.260509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:55:56.262634 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:55:56.262606    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3a9369_e93d_4baf_82ba_2e77e0dea3a1.slice/crio-5b2d5a7b24e278f8aece9287e0776a65453914cb3eb9d2c30baf47ddb8eebd7d WatchSource:0}: Error finding container 5b2d5a7b24e278f8aece9287e0776a65453914cb3eb9d2c30baf47ddb8eebd7d: Status 404 returned error can't find the container with id 5b2d5a7b24e278f8aece9287e0776a65453914cb3eb9d2c30baf47ddb8eebd7d
Jul 29 17:55:56.544062 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.544018    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c4b8dcfc-h9xxn" event={"ID":"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1","Type":"ContainerStarted","Data":"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"}
Jul 29 17:55:56.544263 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.544116    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c4b8dcfc-h9xxn" event={"ID":"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1","Type":"ContainerStarted","Data":"5b2d5a7b24e278f8aece9287e0776a65453914cb3eb9d2c30baf47ddb8eebd7d"}
Jul 29 17:55:56.562258 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.562138    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c4b8dcfc-h9xxn" podStartSLOduration=1.5621227069999999 podStartE2EDuration="1.562122707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:55:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:55:56.560864175 +0000 UTC m=+179.533906354" watchObservedRunningTime="2026-07-29 17:55:56.562122707 +0000 UTC m=+179.535164885"
Jul 29 17:55:56.605378 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.605320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:55:56.656578 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:55:56.656548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:56:06.121005 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.120948    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:56:06.121657 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.121032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:56:06.125959 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.125928    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:56:06.586093 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.586015    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:56:06.631741 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.631705    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:56:06.748575 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.748544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:56:06.847371 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.847339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:56:06.916462 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:06.916430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:56:31.652568 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.652503    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d9f587f6f-fnzn4" podUID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" containerName="console" containerID="cri-o://8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2" gracePeriod=15
Jul 29 17:56:31.898418 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.898388    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:56:31.946468 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946378    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946468 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946435    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946493    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftqcv\" (UniqueName: \"kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946582    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946825 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946699    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946825 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle\") pod \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\" (UID: \"91d0caa8-9c15-4aa1-9e2e-677b419edb77\") "
Jul 29 17:56:31.946934 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946804    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca" (OuterVolumeSpecName: "service-ca") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:56:31.947023 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.946991    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config" (OuterVolumeSpecName: "console-config") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:56:31.947081 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.947037    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:56:31.947157 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.947139    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:31.947309 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.947267    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:56:31.948751 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.948718    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:56:31.948751 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.948734    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:56:31.948871 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:31.948825    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv" (OuterVolumeSpecName: "kube-api-access-ftqcv") pod "91d0caa8-9c15-4aa1-9e2e-677b419edb77" (UID: "91d0caa8-9c15-4aa1-9e2e-677b419edb77"). InnerVolumeSpecName "kube-api-access-ftqcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:56:32.048188 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048154    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.048188 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048184    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftqcv\" (UniqueName: \"kubernetes.io/projected/91d0caa8-9c15-4aa1-9e2e-677b419edb77-kube-api-access-ftqcv\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.048188 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048205    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-oauth-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.048428 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048216    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-oauth-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.048428 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048226    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d0caa8-9c15-4aa1-9e2e-677b419edb77-trusted-ca-bundle\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.048428 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.048234    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/91d0caa8-9c15-4aa1-9e2e-677b419edb77-console-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:56:32.685109 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.685072    2563 generic.go:356] "Generic (PLEG): container finished" podID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" containerID="8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2" exitCode=0
Jul 29 17:56:32.685512 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.685121    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d9f587f6f-fnzn4"
Jul 29 17:56:32.685512 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.685147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f587f6f-fnzn4" event={"ID":"91d0caa8-9c15-4aa1-9e2e-677b419edb77","Type":"ContainerDied","Data":"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"}
Jul 29 17:56:32.685512 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.685222    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d9f587f6f-fnzn4" event={"ID":"91d0caa8-9c15-4aa1-9e2e-677b419edb77","Type":"ContainerDied","Data":"46bd30448f83c32a686df547db08c90eb83a32c118ac2c4e1f2824f754afbd88"}
Jul 29 17:56:32.685512 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.685252    2563 scope.go:117] "RemoveContainer" containerID="8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"
Jul 29 17:56:32.694187 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.694165    2563 scope.go:117] "RemoveContainer" containerID="8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"
Jul 29 17:56:32.694497 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:56:32.694477    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2\": container with ID starting with 8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2 not found: ID does not exist" containerID="8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"
Jul 29 17:56:32.694555 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.694505    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2"} err="failed to get container status \"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2\": rpc error: code = NotFound desc = could not find container \"8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2\": container with ID starting with 8c4cebca89eb8757068b5ea6e9e78066cb9fa8b581344bff27b69266a88742a2 not found: ID does not exist"
Jul 29 17:56:32.705463 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.705430    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:56:32.708603 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:32.708577    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d9f587f6f-fnzn4"]
Jul 29 17:56:33.585355 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:56:33.585326    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" path="/var/lib/kubelet/pods/91d0caa8-9c15-4aa1-9e2e-677b419edb77/volumes"
Jul 29 17:57:02.700005 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:02.699967    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:02.751566 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:02.751531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:14.697693 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:14.697661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:14.772281 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:14.772229    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:22.020637 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:22.020538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:22.121259 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:22.121185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:27.656545 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.656506    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 17:57:27.656961 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.656813    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" containerName="console"
Jul 29 17:57:27.656961 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.656828    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" containerName="console"
Jul 29 17:57:27.656961 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.656899    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91d0caa8-9c15-4aa1-9e2e-677b419edb77" containerName="console"
Jul 29 17:57:27.659001 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.658983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.670588 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.670557    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 17:57:27.701756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.701756 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701761    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.701976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.701976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701837    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf5px\" (UniqueName: \"kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.701976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701864    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.701976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.702097 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.701978    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.704816 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.704782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:27.802651 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802651 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf5px\" (UniqueName: \"kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802679    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802831    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.802927 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.802863    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.803641 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.803609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.803787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.803728    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.803787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.803743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.803878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.803802    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.805456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.805433    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.805630 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.805609    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.811301 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.811272    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf5px\" (UniqueName: \"kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px\") pod \"console-bd5455dc9-4q5n9\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") " pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:27.850336 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.850306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:27.898555 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.898517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:27.969751 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:27.969665    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:28.111268 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.111229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 17:57:28.115058 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:57:28.115018    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e5e2ab3_405e_4f4d_8c22_a36cecb19977.slice/crio-bbeca0a7884203fbdfc01415203e8aadb5793bc9be8f33e930f838334e359305 WatchSource:0}: Error finding container bbeca0a7884203fbdfc01415203e8aadb5793bc9be8f33e930f838334e359305: Status 404 returned error can't find the container with id bbeca0a7884203fbdfc01415203e8aadb5793bc9be8f33e930f838334e359305
Jul 29 17:57:28.456924 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.456893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:28.511498 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.511458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:28.896741 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.896707    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd5455dc9-4q5n9" event={"ID":"8e5e2ab3-405e-4f4d-8c22-a36cecb19977","Type":"ContainerStarted","Data":"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"}
Jul 29 17:57:28.897283 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.896766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd5455dc9-4q5n9" event={"ID":"8e5e2ab3-405e-4f4d-8c22-a36cecb19977","Type":"ContainerStarted","Data":"bbeca0a7884203fbdfc01415203e8aadb5793bc9be8f33e930f838334e359305"}
Jul 29 17:57:28.915594 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:28.915539    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd5455dc9-4q5n9" podStartSLOduration=1.915520077 podStartE2EDuration="1.915520077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:57:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:57:28.913824927 +0000 UTC m=+271.886867106" watchObservedRunningTime="2026-07-29 17:57:28.915520077 +0000 UTC m=+271.888562257"
Jul 29 17:57:37.970564 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:37.970523    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:37.971070 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:37.970619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:37.975836 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:37.975809    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:38.938695 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:38.938666    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 17:57:38.985476 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:38.985447    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:57:39.101365 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:39.101334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:39.202597 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:39.202504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:39.303755 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:39.303724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:57.423166 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:57.423139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 17:57:57.426143 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:57.426115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:57:57.427571 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:57.427550    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 17:57:57.430666 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:57.430641    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 17:57:57.433393 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:57.433363    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 17:57:58.520481 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:58.520440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:57:58.611527 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:57:58.611492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:03.317453 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:03.317422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:04.006917 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.006838    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77c4b8dcfc-h9xxn" podUID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" containerName="console" containerID="cri-o://3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e" gracePeriod=15
Jul 29 17:58:04.255317 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.255290    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:58:04.312406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312308    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312365    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fphcj\" (UniqueName: \"kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312406 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312393    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312630 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312569    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312630 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312617    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312733 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312733 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312700    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config\") pod \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\" (UID: \"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1\") "
Jul 29 17:58:04.312851 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312824    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca" (OuterVolumeSpecName: "service-ca") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:58:04.312974 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312955    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.313032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312974    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:58:04.313032 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.312985    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config" (OuterVolumeSpecName: "console-config") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:58:04.313107 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.313058    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 17:58:04.314643 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.314616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj" (OuterVolumeSpecName: "kube-api-access-fphcj") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "kube-api-access-fphcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 17:58:04.314772 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.314750    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:58:04.314826 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.314773    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" (UID: "cc3a9369-e93d-4baf-82ba-2e77e0dea3a1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 17:58:04.413482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413426    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.413482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413474    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-oauth-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.413482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413485    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-trusted-ca-bundle\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.413482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413494    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-oauth-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.413482 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413504    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-console-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:04.414014 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:04.413512    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fphcj\" (UniqueName: \"kubernetes.io/projected/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1-kube-api-access-fphcj\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 17:58:05.033077 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.033041    2563 generic.go:356] "Generic (PLEG): container finished" podID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" containerID="3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e" exitCode=0
Jul 29 17:58:05.033289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.033089    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c4b8dcfc-h9xxn"
Jul 29 17:58:05.033289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.033124    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c4b8dcfc-h9xxn" event={"ID":"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1","Type":"ContainerDied","Data":"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"}
Jul 29 17:58:05.033289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.033176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c4b8dcfc-h9xxn" event={"ID":"cc3a9369-e93d-4baf-82ba-2e77e0dea3a1","Type":"ContainerDied","Data":"5b2d5a7b24e278f8aece9287e0776a65453914cb3eb9d2c30baf47ddb8eebd7d"}
Jul 29 17:58:05.033289 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.033216    2563 scope.go:117] "RemoveContainer" containerID="3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"
Jul 29 17:58:05.042052 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.042033    2563 scope.go:117] "RemoveContainer" containerID="3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"
Jul 29 17:58:05.042380 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:58:05.042360    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e\": container with ID starting with 3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e not found: ID does not exist" containerID="3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"
Jul 29 17:58:05.042441 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.042390    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e"} err="failed to get container status \"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e\": rpc error: code = NotFound desc = could not find container \"3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e\": container with ID starting with 3966285f13be053925106c9e50af0ce494ca0b50d135f149969ac991b2d0eb0e not found: ID does not exist"
Jul 29 17:58:05.054157 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.054125    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:58:05.058113 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.058090    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c4b8dcfc-h9xxn"]
Jul 29 17:58:05.584936 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:05.584904    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" path="/var/lib/kubelet/pods/cc3a9369-e93d-4baf-82ba-2e77e0dea3a1/volumes"
Jul 29 17:58:25.484662 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:25.484630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:26.799834 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:26.799799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:29.246986 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:29.246955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:29.347125 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:29.347086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:30.830637 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:30.830601    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:30.937492 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:30.937457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:31.506336 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:31.506301    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:31.602300 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:31.602267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:33.490480 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:33.490447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:33.880888 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:33.880850    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:36.014438 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:36.014405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:36.115577 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:36.115545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:39.652887 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:39.652849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:39.747878 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:39.747841    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:42.287415 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:42.287384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:44.176056 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.176022    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6j5b2"]
Jul 29 17:58:44.176475 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.176308    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" containerName="console"
Jul 29 17:58:44.176475 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.176319    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" containerName="console"
Jul 29 17:58:44.176475 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.176395    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc3a9369-e93d-4baf-82ba-2e77e0dea3a1" containerName="console"
Jul 29 17:58:44.178449 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.178431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.181311 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.181285    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 17:58:44.182514 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.182495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6m98v\""
Jul 29 17:58:44.182620 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.182526    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 17:58:44.187935 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.187913    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6j5b2"]
Jul 29 17:58:44.330914 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.330870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.331092 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.330946    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjln\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-kube-api-access-gjjln\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.431849 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.431752    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjln\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-kube-api-access-gjjln\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.431849 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.431813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.440824 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.440787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjln\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-kube-api-access-gjjln\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.440824 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.440788    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bb0f0f48-6610-4ab9-9796-98413ef9a56a-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6j5b2\" (UID: \"bb0f0f48-6610-4ab9-9796-98413ef9a56a\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.487774 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.487740    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:44.623108 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.623078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6j5b2"]
Jul 29 17:58:44.625741 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:58:44.625712    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0f0f48_6610_4ab9_9796_98413ef9a56a.slice/crio-aa0991a2a9f83f2d11a160d98e621cb1a849c4508ef60365ed01358a444289b3 WatchSource:0}: Error finding container aa0991a2a9f83f2d11a160d98e621cb1a849c4508ef60365ed01358a444289b3: Status 404 returned error can't find the container with id aa0991a2a9f83f2d11a160d98e621cb1a849c4508ef60365ed01358a444289b3
Jul 29 17:58:44.627671 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:44.627653    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 17:58:45.198214 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:45.198161    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2" event={"ID":"bb0f0f48-6610-4ab9-9796-98413ef9a56a","Type":"ContainerStarted","Data":"aa0991a2a9f83f2d11a160d98e621cb1a849c4508ef60365ed01358a444289b3"}
Jul 29 17:58:45.276589 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:45.276553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:45.388581 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:45.388543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:47.399635 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:47.399600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:47.998591 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:47.998486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:48.121420 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:48.121388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:58:48.213652 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:48.213613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2" event={"ID":"bb0f0f48-6610-4ab9-9796-98413ef9a56a","Type":"ContainerStarted","Data":"db5506ddce415ec68f6d8c8b7776f575d4b54a3d358bf2c43b7404d63bafc817"}
Jul 29 17:58:48.213850 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:48.213674    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:58:48.250302 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:48.250182    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2" podStartSLOduration=1.18405725 podStartE2EDuration="4.250165732s" totalImagesPullingTime="3.066108482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:58:48.249424136 +0000 UTC m=+351.222466316" watchObservedRunningTime="2026-07-29 17:58:48.250165732 +0000 UTC m=+351.223207912"
Jul 29 17:58:54.220262 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:58:54.220160    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6j5b2"
Jul 29 17:59:03.039994 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:03.039942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:03.170274 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:03.170236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:03.640275 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:03.640242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.095685 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.095653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.193553 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.193519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.231879 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.231838    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"]
Jul 29 17:59:04.235372 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.235344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.239646 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.239611    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 17:59:04.239646 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.239621    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 17:59:04.239880 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.239714    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 17:59:04.239880 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.239732    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wwfrm\""
Jul 29 17:59:04.239985 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.239941    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 17:59:04.257835 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.257798    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"]
Jul 29 17:59:04.399027 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.398937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.399172 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.399075    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.399172 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.399108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcmwl\" (UniqueName: \"kubernetes.io/projected/5d88c664-c56a-47e3-9617-eefc16b28b1d-kube-api-access-dcmwl\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.399293 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.399183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.399293 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.399240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.399293 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.399279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.498818 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.498783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.499814 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.499794    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.499873 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.499834    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.499873 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.499861    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcmwl\" (UniqueName: \"kubernetes.io/projected/5d88c664-c56a-47e3-9617-eefc16b28b1d-kube-api-access-dcmwl\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.499937 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.499921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.499970 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.499943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.500345 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.500322    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-manifests\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.502206 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.502175    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d88c664-c56a-47e3-9617-eefc16b28b1d-tmp\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.502581 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.502560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.502627 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.502570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d88c664-c56a-47e3-9617-eefc16b28b1d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.508180 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.508156    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcmwl\" (UniqueName: \"kubernetes.io/projected/5d88c664-c56a-47e3-9617-eefc16b28b1d-kube-api-access-dcmwl\") pod \"opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2\" (UID: \"5d88c664-c56a-47e3-9617-eefc16b28b1d\") " pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.546083 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.546044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:04.600572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.600457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.693069 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.693000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"]
Jul 29 17:59:04.696090 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:04.696056    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d88c664_c56a_47e3_9617_eefc16b28b1d.slice/crio-fbdcce22ce4cc1a75451d1675ae1c52a44a144328bb10e2a6979898f693a48bc WatchSource:0}: Error finding container fbdcce22ce4cc1a75451d1675ae1c52a44a144328bb10e2a6979898f693a48bc: Status 404 returned error can't find the container with id fbdcce22ce4cc1a75451d1675ae1c52a44a144328bb10e2a6979898f693a48bc
Jul 29 17:59:04.703731 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.703706    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.768926 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.768894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:04.870257 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:04.870222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:05.281284 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:05.281237    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2" event={"ID":"5d88c664-c56a-47e3-9617-eefc16b28b1d","Type":"ContainerStarted","Data":"fbdcce22ce4cc1a75451d1675ae1c52a44a144328bb10e2a6979898f693a48bc"}
Jul 29 17:59:08.300582 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:08.300550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2" event={"ID":"5d88c664-c56a-47e3-9617-eefc16b28b1d","Type":"ContainerStarted","Data":"01aa31fa32ca7c956406357fc552191f5926c3ba87582c97a7f19822c3645134"}
Jul 29 17:59:09.306667 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:09.306630    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d88c664-c56a-47e3-9617-eefc16b28b1d" containerID="01aa31fa32ca7c956406357fc552191f5926c3ba87582c97a7f19822c3645134" exitCode=0
Jul 29 17:59:09.307047 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:09.306721    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2" event={"ID":"5d88c664-c56a-47e3-9617-eefc16b28b1d","Type":"ContainerDied","Data":"01aa31fa32ca7c956406357fc552191f5926c3ba87582c97a7f19822c3645134"}
Jul 29 17:59:10.312680 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:10.312640    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2" event={"ID":"5d88c664-c56a-47e3-9617-eefc16b28b1d","Type":"ContainerStarted","Data":"c815bddba6c8d69cdf708888a3dac40c5acbf142413dc4c43ff2fb0c449bec88"}
Jul 29 17:59:10.313079 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:10.312759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:10.334514 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:10.334457    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2" podStartSLOduration=2.086256492 podStartE2EDuration="6.334439954s" totalImagesPullingTime="3.238970698s" totalInitContainerRuntime="1.009212764s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:10.333425038 +0000 UTC m=+373.306467238" watchObservedRunningTime="2026-07-29 17:59:10.334439954 +0000 UTC m=+373.307482134"
Jul 29 17:59:14.499897 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:14.499848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:14.599999 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:14.599934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:15.590456 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:15.590422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:15.690108 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:15.690077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:21.320087 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:21.320051    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2"
Jul 29 17:59:23.382953 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:23.382905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:23.584073 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:23.584043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:24.144232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.144177    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-728md"]
Jul 29 17:59:24.155213 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.155166    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.157093 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.157063    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-728md"]
Jul 29 17:59:24.160516 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.160489    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lkp6c\""
Jul 29 17:59:24.160661 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.160623    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 29 17:59:24.187390 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.187360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:24.260728 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.260688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:24.263907 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.263879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.264078 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.263940    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf2pt\" (UniqueName: \"kubernetes.io/projected/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-kube-api-access-cf2pt\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.364891 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.364852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.365044 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.364898    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf2pt\" (UniqueName: \"kubernetes.io/projected/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-kube-api-access-cf2pt\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.365044 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:24.365010    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 17:59:24.365150 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:24.365083    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert podName:91c1c5d7-b3ae-41c9-8ed2-068473a59e3d nodeName:}" failed. No retries permitted until 2026-07-29 17:59:24.865064027 +0000 UTC m=+387.838106188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert") pod "odh-model-controller-7998c67dc4-728md" (UID: "91c1c5d7-b3ae-41c9-8ed2-068473a59e3d") : secret "odh-model-controller-webhook-cert" not found
Jul 29 17:59:24.386825 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.386793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf2pt\" (UniqueName: \"kubernetes.io/projected/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-kube-api-access-cf2pt\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.717636 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.717591    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zxvtr"]
Jul 29 17:59:24.720242 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.720218    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.722871 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.722846    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 29 17:59:24.731389 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.731361    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zxvtr"]
Jul 29 17:59:24.741063 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.741033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:24.769128 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.769091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72d5z\" (UniqueName: \"kubernetes.io/projected/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-kube-api-access-72d5z\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.769325 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.769291    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-tls-certs\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.838613 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.838572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:24.870159 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.870117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-tls-certs\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.870371 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.870177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72d5z\" (UniqueName: \"kubernetes.io/projected/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-kube-api-access-72d5z\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.870371 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.870258    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:24.870490 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:24.870385    2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 29 17:59:24.870490 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:24.870469    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert podName:91c1c5d7-b3ae-41c9-8ed2-068473a59e3d nodeName:}" failed. No retries permitted until 2026-07-29 17:59:25.870439568 +0000 UTC m=+388.843481732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert") pod "odh-model-controller-7998c67dc4-728md" (UID: "91c1c5d7-b3ae-41c9-8ed2-068473a59e3d") : secret "odh-model-controller-webhook-cert" not found
Jul 29 17:59:24.872863 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.872837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-tls-certs\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:24.878657 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:24.878628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72d5z\" (UniqueName: \"kubernetes.io/projected/f2c0cd6e-dc53-4845-a3f5-088969f54bc0-kube-api-access-72d5z\") pod \"model-serving-api-54d89bd5fc-zxvtr\" (UID: \"f2c0cd6e-dc53-4845-a3f5-088969f54bc0\") " pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:25.017437 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.017350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:25.030976 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.030942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:25.171792 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.171761    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-zxvtr"]
Jul 29 17:59:25.174258 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:25.174178    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c0cd6e_dc53_4845_a3f5_088969f54bc0.slice/crio-e9f76dff0cb184caadfa7d932878eec05e631b871ccc399ed439a102974dd186 WatchSource:0}: Error finding container e9f76dff0cb184caadfa7d932878eec05e631b871ccc399ed439a102974dd186: Status 404 returned error can't find the container with id e9f76dff0cb184caadfa7d932878eec05e631b871ccc399ed439a102974dd186
Jul 29 17:59:25.376290 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.376250    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr" event={"ID":"f2c0cd6e-dc53-4845-a3f5-088969f54bc0","Type":"ContainerStarted","Data":"e9f76dff0cb184caadfa7d932878eec05e631b871ccc399ed439a102974dd186"}
Jul 29 17:59:25.880968 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.880929    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:25.884144 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.884110    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91c1c5d7-b3ae-41c9-8ed2-068473a59e3d-cert\") pod \"odh-model-controller-7998c67dc4-728md\" (UID: \"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d\") " pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:25.968424 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:25.968381    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:26.132342 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:26.132238    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-728md"]
Jul 29 17:59:26.134739 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:26.134709    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c1c5d7_b3ae_41c9_8ed2_068473a59e3d.slice/crio-25f68d5f2bd4ce6ac5572fa1f6c5b56ce20d05e14eede05c3da268d48994f3ce WatchSource:0}: Error finding container 25f68d5f2bd4ce6ac5572fa1f6c5b56ce20d05e14eede05c3da268d48994f3ce: Status 404 returned error can't find the container with id 25f68d5f2bd4ce6ac5572fa1f6c5b56ce20d05e14eede05c3da268d48994f3ce
Jul 29 17:59:26.383327 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:26.383223    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-728md" event={"ID":"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d","Type":"ContainerStarted","Data":"25f68d5f2bd4ce6ac5572fa1f6c5b56ce20d05e14eede05c3da268d48994f3ce"}
Jul 29 17:59:27.392257 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:27.392210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr" event={"ID":"f2c0cd6e-dc53-4845-a3f5-088969f54bc0","Type":"ContainerStarted","Data":"9ad85c1265df564dfeacab8503dc9bc56d27d860df15970256be4b2cb5e7410e"}
Jul 29 17:59:27.392748 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:27.392473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:27.411463 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:27.411391    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr" podStartSLOduration=1.9471492609999999 podStartE2EDuration="3.411366597s" totalImagesPullingTime="1.464217336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:27.408335715 +0000 UTC m=+390.381377902" watchObservedRunningTime="2026-07-29 17:59:27.411366597 +0000 UTC m=+390.384408758"
Jul 29 17:59:29.406093 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:29.406054    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-728md" event={"ID":"91c1c5d7-b3ae-41c9-8ed2-068473a59e3d","Type":"ContainerStarted","Data":"53d43c032cc7dc9eb68badd6fe21b5ff1795fb2431279cd3144bba20074a11e3"}
Jul 29 17:59:29.406604 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:29.406155    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:34.084874 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.084845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:34.135348 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.135292    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-728md" podStartSLOduration=7.38258996 podStartE2EDuration="10.135274007s" totalImagesPullingTime="2.752684047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:29.424084916 +0000 UTC m=+392.397127097" watchObservedRunningTime="2026-07-29 17:59:34.135274007 +0000 UTC m=+397.108316165"
Jul 29 17:59:34.135910 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.135892    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q922c"]
Jul 29 17:59:34.138387 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.138369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.141720 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.141696    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 29 17:59:34.142810 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.142787    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-q7wp9\""
Jul 29 17:59:34.160592 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.160555    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q922c"]
Jul 29 17:59:34.162078 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.162052    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"]
Jul 29 17:59:34.164561 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.164540    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.167130 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.167111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 29 17:59:34.167299 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.167147    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8bgmk\""
Jul 29 17:59:34.175402 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.175370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"]
Jul 29 17:59:34.185596 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.185539    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:34.257141 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.257103    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.257141 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.257146    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnl4q\" (UniqueName: \"kubernetes.io/projected/25307baa-9c6e-49ae-b822-a1e6d416c099-kube-api-access-pnl4q\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.257435 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.257182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25307baa-9c6e-49ae-b822-a1e6d416c099-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.257435 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.257300    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b97vt\" (UniqueName: \"kubernetes.io/projected/8850ccc6-399f-442c-970f-bea3ea2ef73f-kube-api-access-b97vt\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.358232 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.358169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25307baa-9c6e-49ae-b822-a1e6d416c099-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.358403 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.358262    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b97vt\" (UniqueName: \"kubernetes.io/projected/8850ccc6-399f-442c-970f-bea3ea2ef73f-kube-api-access-b97vt\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.358403 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.358324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.358403 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.358356    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnl4q\" (UniqueName: \"kubernetes.io/projected/25307baa-9c6e-49ae-b822-a1e6d416c099-kube-api-access-pnl4q\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.358585 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:34.358508    2563 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 29 17:59:34.358585 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:34.358581    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert podName:8850ccc6-399f-442c-970f-bea3ea2ef73f nodeName:}" failed. No retries permitted until 2026-07-29 17:59:34.858558993 +0000 UTC m=+397.831601151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert") pod "kserve-controller-manager-d6f4b65b8-q922c" (UID: "8850ccc6-399f-442c-970f-bea3ea2ef73f") : secret "kserve-webhook-server-cert" not found
Jul 29 17:59:34.360757 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.360730    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25307baa-9c6e-49ae-b822-a1e6d416c099-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.371696 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.371657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnl4q\" (UniqueName: \"kubernetes.io/projected/25307baa-9c6e-49ae-b822-a1e6d416c099-kube-api-access-pnl4q\") pod \"llmisvc-controller-manager-777c6bd7d5-k7xq8\" (UID: \"25307baa-9c6e-49ae-b822-a1e6d416c099\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.371696 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.371687    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b97vt\" (UniqueName: \"kubernetes.io/projected/8850ccc6-399f-442c-970f-bea3ea2ef73f-kube-api-access-b97vt\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.373418 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.373385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:34.476599 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.476553    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:34.587137 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.587104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:34.624389 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.624363    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"]
Jul 29 17:59:34.627003 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:34.626974    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25307baa_9c6e_49ae_b822_a1e6d416c099.slice/crio-99036f4d177fe2ecfec66432bfb1af3d1bc4b48ffb6d366eeacb557ce1100d4b WatchSource:0}: Error finding container 99036f4d177fe2ecfec66432bfb1af3d1bc4b48ffb6d366eeacb557ce1100d4b: Status 404 returned error can't find the container with id 99036f4d177fe2ecfec66432bfb1af3d1bc4b48ffb6d366eeacb557ce1100d4b
Jul 29 17:59:34.678975 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.678943    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"]
Jul 29 17:59:34.679501 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.679470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:34.682429 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.682406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.686867 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.686843    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 29 17:59:34.687633 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.687609    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 17:59:34.687633 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.687635    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 29 17:59:34.687787 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.687706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-49xrc\""
Jul 29 17:59:34.688372 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.688348    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 17:59:34.701725 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.701696    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"]
Jul 29 17:59:34.762619 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.762578    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjfm\" (UniqueName: \"kubernetes.io/projected/8bd0af73-ea1f-40e1-9320-b94e8f473651-kube-api-access-6bjfm\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.762800 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.762639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.762800 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.762737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd0af73-ea1f-40e1-9320-b94e8f473651-tmp\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.863572 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.863529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjfm\" (UniqueName: \"kubernetes.io/projected/8bd0af73-ea1f-40e1-9320-b94e8f473651-kube-api-access-6bjfm\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.863766 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.863600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.863766 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.863632    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.863766 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.863648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd0af73-ea1f-40e1-9320-b94e8f473651-tmp\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.863766 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:34.863750    2563 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 29 17:59:34.863990 ip-10-0-142-182 kubenswrapper[2563]: E0729 17:59:34.863820    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs podName:8bd0af73-ea1f-40e1-9320-b94e8f473651 nodeName:}" failed. No retries permitted until 2026-07-29 17:59:35.363803237 +0000 UTC m=+398.336845399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs") pod "kube-auth-proxy-786b455d9f-r7fk8" (UID: "8bd0af73-ea1f-40e1-9320-b94e8f473651") : secret "kube-auth-proxy-tls" not found
Jul 29 17:59:34.865984 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.865959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8bd0af73-ea1f-40e1-9320-b94e8f473651-tmp\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.866114 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.866090    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8850ccc6-399f-442c-970f-bea3ea2ef73f-cert\") pod \"kserve-controller-manager-d6f4b65b8-q922c\" (UID: \"8850ccc6-399f-442c-970f-bea3ea2ef73f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:34.880813 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.880742    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjfm\" (UniqueName: \"kubernetes.io/projected/8bd0af73-ea1f-40e1-9320-b94e8f473651-kube-api-access-6bjfm\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:34.961329 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:34.961286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:35.049082 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.049047    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:35.199742 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.199717    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-q922c"]
Jul 29 17:59:35.227116 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:35.227080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8850ccc6_399f_442c_970f_bea3ea2ef73f.slice/crio-37995cceb1613894ce516dccdfafa092ebfc04834ba09aa030587b3a038e4a6c WatchSource:0}: Error finding container 37995cceb1613894ce516dccdfafa092ebfc04834ba09aa030587b3a038e4a6c: Status 404 returned error can't find the container with id 37995cceb1613894ce516dccdfafa092ebfc04834ba09aa030587b3a038e4a6c
Jul 29 17:59:35.368374 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.368334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:35.371382 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.371329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bd0af73-ea1f-40e1-9320-b94e8f473651-tls-certs\") pod \"kube-auth-proxy-786b455d9f-r7fk8\" (UID: \"8bd0af73-ea1f-40e1-9320-b94e8f473651\") " pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:35.427729 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.427640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:35.433472 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.433418    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c" event={"ID":"8850ccc6-399f-442c-970f-bea3ea2ef73f","Type":"ContainerStarted","Data":"37995cceb1613894ce516dccdfafa092ebfc04834ba09aa030587b3a038e4a6c"}
Jul 29 17:59:35.434830 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.434795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8" event={"ID":"25307baa-9c6e-49ae-b822-a1e6d416c099","Type":"ContainerStarted","Data":"99036f4d177fe2ecfec66432bfb1af3d1bc4b48ffb6d366eeacb557ce1100d4b"}
Jul 29 17:59:35.520821 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.520779    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:35.586255 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.586216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:35.592214 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:35.592150    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"
Jul 29 17:59:36.090643 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.090615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8"]
Jul 29 17:59:36.093106 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:36.093074    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd0af73_ea1f_40e1_9320_b94e8f473651.slice/crio-51b2b50840d515c51406ef3ade6415aaae11c08d36eb49852f75138afdcbaee4 WatchSource:0}: Error finding container 51b2b50840d515c51406ef3ade6415aaae11c08d36eb49852f75138afdcbaee4: Status 404 returned error can't find the container with id 51b2b50840d515c51406ef3ade6415aaae11c08d36eb49852f75138afdcbaee4
Jul 29 17:59:36.440891 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.440851    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8" event={"ID":"8bd0af73-ea1f-40e1-9320-b94e8f473651","Type":"ContainerStarted","Data":"51b2b50840d515c51406ef3ade6415aaae11c08d36eb49852f75138afdcbaee4"}
Jul 29 17:59:36.605688 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.605649    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"]
Jul 29 17:59:36.609485 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.609455    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.610758 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.610722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:36.612320 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.612270    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 17:59:36.612700 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.612676    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 17:59:36.612811 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.612735    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 17:59:36.612811 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.612738    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 17:59:36.612926 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.612681    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5r8bf\""
Jul 29 17:59:36.623220 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.622324    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"]
Jul 29 17:59:36.682277 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682239    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682387    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682412    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56ede77f-1efa-485d-a724-050ca8cad2fe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682479 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682458    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2g5s\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-kube-api-access-c2g5s\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.682746 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.682567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.685728 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.685663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:36.783544 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.783443    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784469    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784517    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56ede77f-1efa-485d-a724-050ca8cad2fe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2g5s\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-kube-api-access-c2g5s\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.784708    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.785633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.788958    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/56ede77f-1efa-485d-a724-050ca8cad2fe-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.789610 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.789153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.791781 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.791503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.793845 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.793770    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.794072 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.794034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.795092 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.795054    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2g5s\" (UniqueName: \"kubernetes.io/projected/56ede77f-1efa-485d-a724-050ca8cad2fe-kube-api-access-c2g5s\") pod \"istiod-openshift-gateway-5677ccb49b-89ssf\" (UID: \"56ede77f-1efa-485d-a724-050ca8cad2fe\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:36.923961 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:36.923919    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:37.784104 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:37.784053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:38.403658 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:38.403624    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-zxvtr"
Jul 29 17:59:38.855115 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:38.855090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"]
Jul 29 17:59:38.857067 ip-10-0-142-182 kubenswrapper[2563]: W0729 17:59:38.857032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ede77f_1efa_485d_a724_050ca8cad2fe.slice/crio-829c67e0340d33b38095e1fe51cd1f365929f8973f354eff3bfc258de6442dcb WatchSource:0}: Error finding container 829c67e0340d33b38095e1fe51cd1f365929f8973f354eff3bfc258de6442dcb: Status 404 returned error can't find the container with id 829c67e0340d33b38095e1fe51cd1f365929f8973f354eff3bfc258de6442dcb
Jul 29 17:59:39.460354 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.460313    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c" event={"ID":"8850ccc6-399f-442c-970f-bea3ea2ef73f","Type":"ContainerStarted","Data":"6d1abf10fccc965ffb66109df86e0c791dc287bd78c460317bc7f4e6af1647a4"}
Jul 29 17:59:39.460557 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.460482    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 17:59:39.461823 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.461798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf" event={"ID":"56ede77f-1efa-485d-a724-050ca8cad2fe","Type":"ContainerStarted","Data":"829c67e0340d33b38095e1fe51cd1f365929f8973f354eff3bfc258de6442dcb"}
Jul 29 17:59:39.463593 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.463557    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8" event={"ID":"8bd0af73-ea1f-40e1-9320-b94e8f473651","Type":"ContainerStarted","Data":"d1a4e9089fb4eadbc865b67f9bda1d08ebfce4f906358061dbe4a6d9a072e14c"}
Jul 29 17:59:39.465392 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.465365    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8" event={"ID":"25307baa-9c6e-49ae-b822-a1e6d416c099","Type":"ContainerStarted","Data":"d5ca65775a95e5816b64fa033400f5d5455c7eec136624308994821a3c461b21"}
Jul 29 17:59:39.465535 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.465515    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 17:59:39.480602 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.480551    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c" podStartSLOduration=1.998987157 podStartE2EDuration="5.480533168s" totalImagesPullingTime="3.481546011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:39.479635851 +0000 UTC m=+402.452678032" watchObservedRunningTime="2026-07-29 17:59:39.480533168 +0000 UTC m=+402.453575382"
Jul 29 17:59:39.501910 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.501857    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8" podStartSLOduration=1.4205080190000001 podStartE2EDuration="5.501841222s" totalImagesPullingTime="4.081333203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:39.500500172 +0000 UTC m=+402.473542377" watchObservedRunningTime="2026-07-29 17:59:39.501841222 +0000 UTC m=+402.474883438"
Jul 29 17:59:39.517128 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:39.517071    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-786b455d9f-r7fk8" podStartSLOduration=2.896695624 podStartE2EDuration="5.51705703s" totalImagesPullingTime="2.620361406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:39.51681237 +0000 UTC m=+402.489854550" watchObservedRunningTime="2026-07-29 17:59:39.51705703 +0000 UTC m=+402.490099209"
Jul 29 17:59:40.414376 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:40.414335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-728md"
Jul 29 17:59:41.563879 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:41.563838    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 17:59:41.564189 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:41.563910    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 17:59:42.262576 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.262537    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:42.364364 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.364317    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:42.486450 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.486413    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf" event={"ID":"56ede77f-1efa-485d-a724-050ca8cad2fe","Type":"ContainerStarted","Data":"7c3842a2d04e1bb689f885a7f540d24f4c076a952512e276cfbb20f054a4bb9b"}
Jul 29 17:59:42.486621 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.486606    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 17:59:42.488238 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.488188    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-89ssf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 17:59:42.488351 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.488249    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf" podUID="56ede77f-1efa-485d-a724-050ca8cad2fe" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 17:59:42.537824 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.537698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf" podStartSLOduration=3.8336214870000003 podStartE2EDuration="6.537676568s" totalImagesPullingTime="2.704055081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 17:59:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 17:59:42.535926962 +0000 UTC m=+405.508969144" watchObservedRunningTime="2026-07-29 17:59:42.537676568 +0000 UTC m=+405.510718750"
Jul 29 17:59:42.743595 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.743551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:42.863525 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:42.863488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:43.173502 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:43.173411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 17:59:43.492408 ip-10-0-142-182 kubenswrapper[2563]: I0729 17:59:43.492326    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-89ssf"
Jul 29 18:00:10.476901 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:10.476869    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-k7xq8"
Jul 29 18:00:10.480114 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:10.480092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-q922c"
Jul 29 18:00:24.943557 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:24.943458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:25.132995 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:25.132964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:25.230660 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:25.230574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:25.820041 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:25.820005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:26.019775 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:26.019734    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:40.371406 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:40.371370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:42.212641 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:42.212605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:42.317974 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:42.317937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:51.584458 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:51.584415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:55.781515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:55.781482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:56.299758 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.299711    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97fcddd5c-xjb2q"]
Jul 29 18:00:56.303487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.303462    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.316522 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.316495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fcddd5c-xjb2q"]
Jul 29 18:00:56.371838 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.371804    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:56.379053 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379061    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379091    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-oauth-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379158    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-trusted-ca-bundle\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379324 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n44m\" (UniqueName: \"kubernetes.io/projected/7b45d869-0aa1-4974-ab9d-0a377ff72341-kube-api-access-5n44m\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-service-ca\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.379362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.379350    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-oauth-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.477362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.477325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:56.480453 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n44m\" (UniqueName: \"kubernetes.io/projected/7b45d869-0aa1-4974-ab9d-0a377ff72341-kube-api-access-5n44m\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480536 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-service-ca\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480536 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-oauth-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480701 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480763 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480815 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-oauth-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.480951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.480911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-trusted-ca-bundle\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.481256 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.481232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-service-ca\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.481467 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.481448    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-oauth-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.481551 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.481522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.481761 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.481737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b45d869-0aa1-4974-ab9d-0a377ff72341-trusted-ca-bundle\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.483114 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.483086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-oauth-config\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.483207 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.483173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b45d869-0aa1-4974-ab9d-0a377ff72341-console-serving-cert\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.490852 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.490835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n44m\" (UniqueName: \"kubernetes.io/projected/7b45d869-0aa1-4974-ab9d-0a377ff72341-kube-api-access-5n44m\") pod \"console-97fcddd5c-xjb2q\" (UID: \"7b45d869-0aa1-4974-ab9d-0a377ff72341\") " pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.613882 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.613842    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:00:56.757278 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.757254    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97fcddd5c-xjb2q"]
Jul 29 18:00:56.759913 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:00:56.759883    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b45d869_0aa1_4974_ab9d_0a377ff72341.slice/crio-2b3029abbc85e3bed88bfc12f1337e96125897909d268dadf253fc429946f6de WatchSource:0}: Error finding container 2b3029abbc85e3bed88bfc12f1337e96125897909d268dadf253fc429946f6de: Status 404 returned error can't find the container with id 2b3029abbc85e3bed88bfc12f1337e96125897909d268dadf253fc429946f6de
Jul 29 18:00:56.813848 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:56.813817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fcddd5c-xjb2q" event={"ID":"7b45d869-0aa1-4974-ab9d-0a377ff72341","Type":"ContainerStarted","Data":"2b3029abbc85e3bed88bfc12f1337e96125897909d268dadf253fc429946f6de"}
Jul 29 18:00:57.701542 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.701508    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"]
Jul 29 18:00:57.706606 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.706582    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:57.710423 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.710360    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jvzjt\""
Jul 29 18:00:57.710677 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.710648    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 18:00:57.711938 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.711913    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 18:00:57.715698 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.715671    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"]
Jul 29 18:00:57.790974 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.790935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hmmp\" (UniqueName: \"kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp\") pod \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" (UID: \"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:57.820876 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.820836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97fcddd5c-xjb2q" event={"ID":"7b45d869-0aa1-4974-ab9d-0a377ff72341","Type":"ContainerStarted","Data":"ae46115530d8bfce28bdd13fc6a06ac8f427df158ecf90e184a5a9af05657256"}
Jul 29 18:00:57.851416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.851362    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97fcddd5c-xjb2q" podStartSLOduration=1.851342923 podStartE2EDuration="1.851342923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:00:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:00:57.849971114 +0000 UTC m=+480.823013294" watchObservedRunningTime="2026-07-29 18:00:57.851342923 +0000 UTC m=+480.824385174"
Jul 29 18:00:57.891648 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.891609    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hmmp\" (UniqueName: \"kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp\") pod \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" (UID: \"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:57.902424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:57.902391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hmmp\" (UniqueName: \"kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp\") pod \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" (UID: \"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:58.019098 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:58.019002    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:58.180325 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:58.180298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"]
Jul 29 18:00:58.183272 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:00:58.183243    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe57d5c5_07d9_4a92_a3f6_f64bdac3e287.slice/crio-243c7e90b9dd42a534f8e919fdd2e65a3a148a850a7d7ae5f01392f4b47356a2 WatchSource:0}: Error finding container 243c7e90b9dd42a534f8e919fdd2e65a3a148a850a7d7ae5f01392f4b47356a2: Status 404 returned error can't find the container with id 243c7e90b9dd42a534f8e919fdd2e65a3a148a850a7d7ae5f01392f4b47356a2
Jul 29 18:00:58.249694 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:58.249665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:58.398008 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:58.397966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:58.828957 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:58.828847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd" event={"ID":"be57d5c5-07d9-4a92-a3f6-f64bdac3e287","Type":"ContainerStarted","Data":"243c7e90b9dd42a534f8e919fdd2e65a3a148a850a7d7ae5f01392f4b47356a2"}
Jul 29 18:00:59.684572 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:59.684541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:00:59.835099 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:59.835057    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd" event={"ID":"be57d5c5-07d9-4a92-a3f6-f64bdac3e287","Type":"ContainerStarted","Data":"90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7"}
Jul 29 18:00:59.835484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:59.835177    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:00:59.858403 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:00:59.858344    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd" podStartSLOduration=1.423682997 podStartE2EDuration="2.858326723s" totalImagesPullingTime="1.434643726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:00:59.857644897 +0000 UTC m=+482.830687078" watchObservedRunningTime="2026-07-29 18:00:59.858326723 +0000 UTC m=+482.831368903"
Jul 29 18:01:02.771360 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:02.771325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:03.226326 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:03.226293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:03.414934 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:03.414898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:06.250219 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.250162    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:06.614217 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.614156    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:01:06.614391 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.614257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:01:06.619477 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.619450    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:01:06.873409 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.873322    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97fcddd5c-xjb2q"
Jul 29 18:01:06.931047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:06.931006    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 18:01:07.058840 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:07.058809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:07.174435 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:07.174347    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:07.278623 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:07.278586    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:07.591331 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:07.591305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:07.688894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:07.688863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:10.809165 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:10.809128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:10.842689 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:10.842662    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:11.413825 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:11.413791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:11.515777 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:11.515741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:14.767161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:14.767126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:14.867532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:14.867498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:20.365895 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.365850    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"]
Jul 29 18:01:20.369373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.369348    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.372425 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.372397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vznvv\""
Jul 29 18:01:20.380517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.380488    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"]
Jul 29 18:01:20.507880 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.507842    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqkl\" (UniqueName: \"kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.508058 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.507909    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.609227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.609169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqkl\" (UniqueName: \"kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.609391 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.609266    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.609668 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.609651    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.617926 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.617853    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqkl\" (UniqueName: \"kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl\") pod \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.680874 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.680831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:20.834751 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.833132    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"]
Jul 29 18:01:20.835689 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:01:20.835655    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91cd6a8d_3110_4256_b402_17533d60588a.slice/crio-5af77994e1beb9f33b470955309cd6319083f15999041a02ade4fcc97f005028 WatchSource:0}: Error finding container 5af77994e1beb9f33b470955309cd6319083f15999041a02ade4fcc97f005028: Status 404 returned error can't find the container with id 5af77994e1beb9f33b470955309cd6319083f15999041a02ade4fcc97f005028
Jul 29 18:01:20.936843 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.936756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s" event={"ID":"91cd6a8d-3110-4256-b402-17533d60588a","Type":"ContainerStarted","Data":"5af77994e1beb9f33b470955309cd6319083f15999041a02ade4fcc97f005028"}
Jul 29 18:01:20.957566 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.957532    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"]
Jul 29 18:01:20.961695 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:20.961663    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"]
Jul 29 18:01:21.001886 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.001855    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"]
Jul 29 18:01:21.002103 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.002069    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" containerName="manager" containerID="cri-o://90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7" gracePeriod=2
Jul 29 18:01:21.019993 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.019962    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"]
Jul 29 18:01:21.032153 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:21.032113    2563 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-nmgwd\": pods \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:21.040030 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.039999    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"]
Jul 29 18:01:21.040383 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.040370    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" containerName="manager"
Jul 29 18:01:21.040439 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.040385    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" containerName="manager"
Jul 29 18:01:21.040474 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.040461    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" containerName="manager"
Jul 29 18:01:21.043397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.043373    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:21.054642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.054614    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"]
Jul 29 18:01:21.068062 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:21.068017    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:21.215886 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.215776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/643843c6-51b4-4a45-84c5-6368fa95a783-kube-api-access-vz9gc\") pod \"limitador-operator-controller-manager-859d7b78bd-wt788\" (UID: \"643843c6-51b4-4a45-84c5-6368fa95a783\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:21.247709 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.247681    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:21.250358 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:21.250321    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nmgwd\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:21.316831 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.316787    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/643843c6-51b4-4a45-84c5-6368fa95a783-kube-api-access-vz9gc\") pod \"limitador-operator-controller-manager-859d7b78bd-wt788\" (UID: \"643843c6-51b4-4a45-84c5-6368fa95a783\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:21.332255 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.332217    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9gc\" (UniqueName: \"kubernetes.io/projected/643843c6-51b4-4a45-84c5-6368fa95a783-kube-api-access-vz9gc\") pod \"limitador-operator-controller-manager-859d7b78bd-wt788\" (UID: \"643843c6-51b4-4a45-84c5-6368fa95a783\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:21.373361 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.373322    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:21.417713 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.417681    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hmmp\" (UniqueName: \"kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp\") pod \"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\" (UID: \"be57d5c5-07d9-4a92-a3f6-f64bdac3e287\") "
Jul 29 18:01:21.419911 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.419878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp" (OuterVolumeSpecName: "kube-api-access-9hmmp") pod "be57d5c5-07d9-4a92-a3f6-f64bdac3e287" (UID: "be57d5c5-07d9-4a92-a3f6-f64bdac3e287"). InnerVolumeSpecName "kube-api-access-9hmmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:01:21.512595 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.512559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"]
Jul 29 18:01:21.518555 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.518533    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hmmp\" (UniqueName: \"kubernetes.io/projected/be57d5c5-07d9-4a92-a3f6-f64bdac3e287-kube-api-access-9hmmp\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:21.588471 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.588434    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" path="/var/lib/kubelet/pods/be57d5c5-07d9-4a92-a3f6-f64bdac3e287/volumes"
Jul 29 18:01:21.615896 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:01:21.615855    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod643843c6_51b4_4a45_84c5_6368fa95a783.slice/crio-a1613447e9884f6f778a86a4bbf5375351764d87aeb80ee9e29fa40df544b291 WatchSource:0}: Error finding container a1613447e9884f6f778a86a4bbf5375351764d87aeb80ee9e29fa40df544b291: Status 404 returned error can't find the container with id a1613447e9884f6f778a86a4bbf5375351764d87aeb80ee9e29fa40df544b291
Jul 29 18:01:21.945532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.945498    2563 generic.go:356] "Generic (PLEG): container finished" podID="be57d5c5-07d9-4a92-a3f6-f64bdac3e287" containerID="90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7" exitCode=0
Jul 29 18:01:21.945725 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.945556    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmgwd"
Jul 29 18:01:21.945725 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.945619    2563 scope.go:117] "RemoveContainer" containerID="90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7"
Jul 29 18:01:21.946921 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:21.946900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788" event={"ID":"643843c6-51b4-4a45-84c5-6368fa95a783","Type":"ContainerStarted","Data":"a1613447e9884f6f778a86a4bbf5375351764d87aeb80ee9e29fa40df544b291"}
Jul 29 18:01:22.047858 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:22.047834    2563 scope.go:117] "RemoveContainer" containerID="90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7"
Jul 29 18:01:22.048238 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:22.048218    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7\": container with ID starting with 90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7 not found: ID does not exist" containerID="90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7"
Jul 29 18:01:22.048295 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:22.048249    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7"} err="failed to get container status \"90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7\": rpc error: code = NotFound desc = could not find container \"90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7\": container with ID starting with 90f7eb358df0bafd84ab6132fc626b6a78d3fb1d9018a83f69eff63069b5dcc7 not found: ID does not exist"
Jul 29 18:01:22.954269 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:22.954228    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788" event={"ID":"643843c6-51b4-4a45-84c5-6368fa95a783","Type":"ContainerStarted","Data":"5dab775c64085521150115edbd86d971738c1a8ab648673d8ff2d96a630114bb"}
Jul 29 18:01:22.975637 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:22.975576    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788" podStartSLOduration=1.975556952 podStartE2EDuration="1.975556952s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:01:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:01:22.973877243 +0000 UTC m=+505.946919441" watchObservedRunningTime="2026-07-29 18:01:22.975556952 +0000 UTC m=+505.948599129"
Jul 29 18:01:23.219733 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:23.219635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:23.318856 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:23.318812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:23.967723 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:23.967684    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:25.788604 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:25.788516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:25.889858 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:25.889826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:25.980050 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:25.979983    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s" podUID="91cd6a8d-3110-4256-b402-17533d60588a" containerName="manager" containerID="cri-o://f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d" gracePeriod=2
Jul 29 18:01:26.194921 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.194897    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:26.197431 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:26.197394    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="91cd6a8d-3110-4256-b402-17533d60588a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:26.365675 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.365576    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bqkl\" (UniqueName: \"kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl\") pod \"91cd6a8d-3110-4256-b402-17533d60588a\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") "
Jul 29 18:01:26.365675 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.365677    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume\") pod \"91cd6a8d-3110-4256-b402-17533d60588a\" (UID: \"91cd6a8d-3110-4256-b402-17533d60588a\") "
Jul 29 18:01:26.365963 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.365935    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "91cd6a8d-3110-4256-b402-17533d60588a" (UID: "91cd6a8d-3110-4256-b402-17533d60588a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:01:26.367783 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.367757    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl" (OuterVolumeSpecName: "kube-api-access-4bqkl") pod "91cd6a8d-3110-4256-b402-17533d60588a" (UID: "91cd6a8d-3110-4256-b402-17533d60588a"). InnerVolumeSpecName "kube-api-access-4bqkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:01:26.467370 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.467316    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/91cd6a8d-3110-4256-b402-17533d60588a-extensions-socket-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:26.467370 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.467357    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bqkl\" (UniqueName: \"kubernetes.io/projected/91cd6a8d-3110-4256-b402-17533d60588a-kube-api-access-4bqkl\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:26.986343 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.986302    2563 generic.go:356] "Generic (PLEG): container finished" podID="91cd6a8d-3110-4256-b402-17533d60588a" containerID="f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d" exitCode=2
Jul 29 18:01:26.986343 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.986349    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:26.986887 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.986395    2563 scope.go:117] "RemoveContainer" containerID="f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d"
Jul 29 18:01:26.988819 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:26.988785    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="91cd6a8d-3110-4256-b402-17533d60588a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:26.995152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.995135    2563 scope.go:117] "RemoveContainer" containerID="f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d"
Jul 29 18:01:26.995506 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:26.995485    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d\": container with ID starting with f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d not found: ID does not exist" containerID="f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d"
Jul 29 18:01:26.995561 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:26.995518    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d"} err="failed to get container status \"f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d\": rpc error: code = NotFound desc = could not find container \"f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d\": container with ID starting with f168ac1933c8aa139cac8779940bd58c0cd6a1f0c0e0ec8ebf90a9e6dccec25d not found: ID does not exist"
Jul 29 18:01:26.997108 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:26.997081    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="91cd6a8d-3110-4256-b402-17533d60588a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:27.588330 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:27.588273    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-kq54s\" is forbidden: User \"system:node:ip-10-0-142-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-182.ec2.internal' and this object" podUID="91cd6a8d-3110-4256-b402-17533d60588a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kq54s"
Jul 29 18:01:27.593008 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:27.592975    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91cd6a8d-3110-4256-b402-17533d60588a" path="/var/lib/kubelet/pods/91cd6a8d-3110-4256-b402-17533d60588a/volumes"
Jul 29 18:01:28.611498 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:28.611462    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:28.710741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:28.710704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:31.951659 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:31.951613    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bd5455dc9-4q5n9" podUID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" containerName="console" containerID="cri-o://b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a" gracePeriod=15
Jul 29 18:01:32.147434 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.147397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:32.214898 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.214811    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 18:01:32.218750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218724    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218758    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218829    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218857    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf5px\" (UniqueName: \"kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218906    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.218973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.218934    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config\") pod \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\" (UID: \"8e5e2ab3-405e-4f4d-8c22-a36cecb19977\") "
Jul 29 18:01:32.219236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.219161    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:01:32.219236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.219221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config" (OuterVolumeSpecName: "console-config") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:01:32.219331 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.219301    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-trusted-ca-bundle\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.219613 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.219587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:01:32.220058 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.219973    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:01:32.221390 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.221366    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:01:32.221532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.221512    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:01:32.221584 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.221511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px" (OuterVolumeSpecName: "kube-api-access-lf5px") pod "8e5e2ab3-405e-4f4d-8c22-a36cecb19977" (UID: "8e5e2ab3-405e-4f4d-8c22-a36cecb19977"). InnerVolumeSpecName "kube-api-access-lf5px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:01:32.245925 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.245888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:32.319967 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319929    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-oauth-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.319967 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319959    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-oauth-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.319967 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319969    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-serving-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.319967 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319977    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.320257 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319989    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-console-config\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:32.320257 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:32.319996    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf5px\" (UniqueName: \"kubernetes.io/projected/8e5e2ab3-405e-4f4d-8c22-a36cecb19977-kube-api-access-lf5px\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:01:33.017329 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.017291    2563 generic.go:356] "Generic (PLEG): container finished" podID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" containerID="b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a" exitCode=0
Jul 29 18:01:33.017766 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.017349    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd5455dc9-4q5n9"
Jul 29 18:01:33.017766 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.017376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd5455dc9-4q5n9" event={"ID":"8e5e2ab3-405e-4f4d-8c22-a36cecb19977","Type":"ContainerDied","Data":"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"}
Jul 29 18:01:33.017766 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.017435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd5455dc9-4q5n9" event={"ID":"8e5e2ab3-405e-4f4d-8c22-a36cecb19977","Type":"ContainerDied","Data":"bbeca0a7884203fbdfc01415203e8aadb5793bc9be8f33e930f838334e359305"}
Jul 29 18:01:33.017766 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.017463    2563 scope.go:117] "RemoveContainer" containerID="b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"
Jul 29 18:01:33.027217 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.027175    2563 scope.go:117] "RemoveContainer" containerID="b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"
Jul 29 18:01:33.027577 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:01:33.027552    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a\": container with ID starting with b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a not found: ID does not exist" containerID="b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"
Jul 29 18:01:33.027646 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.027587    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a"} err="failed to get container status \"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a\": rpc error: code = NotFound desc = could not find container \"b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a\": container with ID starting with b14969b91e60c9a4c2b338ff72f1d3b514f80659741a49b60857fb9bb2e7041a not found: ID does not exist"
Jul 29 18:01:33.041866 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.041832    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 18:01:33.049688 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.049656    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd5455dc9-4q5n9"]
Jul 29 18:01:33.585660 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:33.585630    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" path="/var/lib/kubelet/pods/8e5e2ab3-405e-4f4d-8c22-a36cecb19977/volumes"
Jul 29 18:01:34.975810 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:34.975777    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wt788"
Jul 29 18:01:36.842813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:36.842781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:36.907611 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:36.907575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:40.973732 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:40.973692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:41.073625 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:41.073591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:43.585061 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:43.585021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:43.685903 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:43.685872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:46.778684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:46.778649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:46.878870 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:46.878837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:50.375789 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.375712    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:50.476211 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.476164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:50.919038 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919003    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:01:50.919428 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919408    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91cd6a8d-3110-4256-b402-17533d60588a" containerName="manager"
Jul 29 18:01:50.919428 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919427    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="91cd6a8d-3110-4256-b402-17533d60588a" containerName="manager"
Jul 29 18:01:50.919521 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919446    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" containerName="console"
Jul 29 18:01:50.919521 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919452    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" containerName="console"
Jul 29 18:01:50.919605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919543    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5e2ab3-405e-4f4d-8c22-a36cecb19977" containerName="console"
Jul 29 18:01:50.919605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.919559    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="91cd6a8d-3110-4256-b402-17533d60588a" containerName="manager"
Jul 29 18:01:50.922460 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.922444    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:50.926001 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.925979    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vznvv\""
Jul 29 18:01:50.940654 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.940624    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:01:50.976920 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.976879    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bfvz\" (UniqueName: \"kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:50.976920 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:50.976922    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.078267 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.078226    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bfvz\" (UniqueName: \"kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.078267 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.078264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.078625 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.078610    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.104317 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.104286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bfvz\" (UniqueName: \"kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz\") pod \"kuadrant-operator-controller-manager-86878c769f-glz49\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.233732 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.233622    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:51.380883 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:51.380857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:01:51.384085 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:01:51.384049    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff32556_461b_4d7f_8d83_a5141ceac3d4.slice/crio-770e1490082ee3fb3cf80603ed7aa95e89b6dcaef9f83f60632de3c6241e1d7a WatchSource:0}: Error finding container 770e1490082ee3fb3cf80603ed7aa95e89b6dcaef9f83f60632de3c6241e1d7a: Status 404 returned error can't find the container with id 770e1490082ee3fb3cf80603ed7aa95e89b6dcaef9f83f60632de3c6241e1d7a
Jul 29 18:01:52.109345 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.109302    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" event={"ID":"6ff32556-461b-4d7f-8d83-a5141ceac3d4","Type":"ContainerStarted","Data":"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"}
Jul 29 18:01:52.109518 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.109413    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:01:52.109518 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.109435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" event={"ID":"6ff32556-461b-4d7f-8d83-a5141ceac3d4","Type":"ContainerStarted","Data":"770e1490082ee3fb3cf80603ed7aa95e89b6dcaef9f83f60632de3c6241e1d7a"}
Jul 29 18:01:52.116222 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.116156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:01:52.133675 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.133616    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" podStartSLOduration=2.133596738 podStartE2EDuration="2.133596738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:01:52.13191066 +0000 UTC m=+535.104952857" watchObservedRunningTime="2026-07-29 18:01:52.133596738 +0000 UTC m=+535.106638988"
Jul 29 18:01:52.214658 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:01:52.214622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:00.374911 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:00.374866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:00.475758 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:00.475718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:00.974994 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:00.974956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:01.048272 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:01.048239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:02.200053 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:02.200018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:03.116756 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:03.116723    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:02:06.995239 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:06.995174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:07.260610 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:07.260511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:12.998488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:12.998449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:13.092360 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:13.092321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:13.190760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:13.190724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:13.808551 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:13.808504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:13.906642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:13.906609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:34.251712 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:34.251675    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:34.421008 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:34.420968    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:34.682799 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:34.682765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:47.226026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:47.225986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:47.385370 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:47.385330    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:54.461873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.461829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:54.462546 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.462523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:02:54.465448 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.465428    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.468437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.468413    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 18:02:54.468556 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.468437    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 18:02:54.468556 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.468414    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-7x8jm\""
Jul 29 18:02:54.481605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.481581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:02:54.526778 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.526742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:54.542924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.542886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg9f\" (UniqueName: \"kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.543094 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.542944    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.644000 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.643961    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg9f\" (UniqueName: \"kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.644248 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.644028    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.644248 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:02:54.644133    2563 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 29 18:02:54.644404 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:02:54.644261    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert podName:9e8e180f-6ea2-43e4-b595-b75e82c2a2f1 nodeName:}" failed. No retries permitted until 2026-07-29 18:02:55.144236421 +0000 UTC m=+598.117278596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert") pod "maas-controller-6d6776d95f-rjfmh" (UID: "9e8e180f-6ea2-43e4-b595-b75e82c2a2f1") : secret "maas-controller-webhook-cert" not found
Jul 29 18:02:54.657270 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.657210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg9f\" (UniqueName: \"kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:54.709793 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:54.709760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:55.149748 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:55.149705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:55.152241 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:55.152214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") pod \"maas-controller-6d6776d95f-rjfmh\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") " pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:55.376414 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:55.376375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:55.518809 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:55.518784    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:02:55.520856 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:02:55.520815    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8e180f_6ea2_43e4_b595_b75e82c2a2f1.slice/crio-0998bcc53ade4fb52feada1d31133186cee99086a9db7e19dde8ce167fece257 WatchSource:0}: Error finding container 0998bcc53ade4fb52feada1d31133186cee99086a9db7e19dde8ce167fece257: Status 404 returned error can't find the container with id 0998bcc53ade4fb52feada1d31133186cee99086a9db7e19dde8ce167fece257
Jul 29 18:02:56.413830 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:56.413714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" event={"ID":"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1","Type":"ContainerStarted","Data":"0998bcc53ade4fb52feada1d31133186cee99086a9db7e19dde8ce167fece257"}
Jul 29 18:02:57.677266 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.677232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:57.709544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.709507    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:02:57.709817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.709799    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:02:57.712586 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.712562    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:02:57.712723 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.712674    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:02:57.735141 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.735116    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 18:02:57.794812 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.794787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:57.899123 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:57.899084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:02:58.425714 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:58.425676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" event={"ID":"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1","Type":"ContainerStarted","Data":"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"}
Jul 29 18:02:58.425911 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:58.425776    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:02:58.443897 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:02:58.443837    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" podStartSLOduration=2.235231633 podStartE2EDuration="4.443813233s" totalImagesPullingTime="2.2085816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:02:58.442745541 +0000 UTC m=+601.415787760" watchObservedRunningTime="2026-07-29 18:02:58.443813233 +0000 UTC m=+601.416855415"
Jul 29 18:03:09.014539 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.014501    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:03:09.019540 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.014833    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" podUID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" containerName="manager" containerID="cri-o://349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532" gracePeriod=30
Jul 29 18:03:09.019540 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.018780    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:03:09.275170 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.275104    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:03:09.378850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.378811    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzg9f\" (UniqueName: \"kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f\") pod \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") "
Jul 29 18:03:09.379026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.378885    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") pod \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\" (UID: \"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1\") "
Jul 29 18:03:09.381113 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.381081    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f" (OuterVolumeSpecName: "kube-api-access-hzg9f") pod "9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" (UID: "9e8e180f-6ea2-43e4-b595-b75e82c2a2f1"). InnerVolumeSpecName "kube-api-access-hzg9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:03:09.381113 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.381092    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" (UID: "9e8e180f-6ea2-43e4-b595-b75e82c2a2f1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:03:09.474275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.474240    2563 generic.go:356] "Generic (PLEG): container finished" podID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" containerID="349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532" exitCode=0
Jul 29 18:03:09.474275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.474282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" event={"ID":"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1","Type":"ContainerDied","Data":"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"}
Jul 29 18:03:09.474532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.474289    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6d6776d95f-rjfmh"
Jul 29 18:03:09.474532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.474322    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6d6776d95f-rjfmh" event={"ID":"9e8e180f-6ea2-43e4-b595-b75e82c2a2f1","Type":"ContainerDied","Data":"0998bcc53ade4fb52feada1d31133186cee99086a9db7e19dde8ce167fece257"}
Jul 29 18:03:09.474532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.474344    2563 scope.go:117] "RemoveContainer" containerID="349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"
Jul 29 18:03:09.479474 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.479442    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzg9f\" (UniqueName: \"kubernetes.io/projected/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-kube-api-access-hzg9f\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:03:09.479474 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.479464    2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1-webhook-cert\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:03:09.483110 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.483091    2563 scope.go:117] "RemoveContainer" containerID="349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"
Jul 29 18:03:09.483443 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:03:09.483423    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532\": container with ID starting with 349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532 not found: ID does not exist" containerID="349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"
Jul 29 18:03:09.483517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.483456    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532"} err="failed to get container status \"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532\": rpc error: code = NotFound desc = could not find container \"349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532\": container with ID starting with 349fb623201b812f7bcb4f1c59251204e1976a161513f5bedfbf05cf7a30d532 not found: ID does not exist"
Jul 29 18:03:09.497541 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.497511    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:03:09.501282 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.501259    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6d6776d95f-rjfmh"]
Jul 29 18:03:09.586038 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:09.585948    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" path="/var/lib/kubelet/pods/9e8e180f-6ea2-43e4-b595-b75e82c2a2f1/volumes"
Jul 29 18:03:19.840151 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:19.840031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:28.418134 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:28.418086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:30.399403 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.399362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:30.496831 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.496793    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:30.504255 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.504218    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"]
Jul 29 18:03:30.504623 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.504606    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" containerName="manager"
Jul 29 18:03:30.504708 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.504625    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" containerName="manager"
Jul 29 18:03:30.504767 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.504727    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e8e180f-6ea2-43e4-b595-b75e82c2a2f1" containerName="manager"
Jul 29 18:03:30.507809 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.507785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.510726 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.510706    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9b59x\""
Jul 29 18:03:30.510853 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.510787    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 18:03:30.518235 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.518208    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"]
Jul 29 18:03:30.543941 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.543907    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dglr4"]
Jul 29 18:03:30.547304 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.547284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.559553 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.559509    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dglr4"]
Jul 29 18:03:30.562882 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.562851    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtkl2\" (UniqueName: \"kubernetes.io/projected/3864dce7-cea7-4c15-8605-3ae4cef7292a-kube-api-access-qtkl2\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.563053 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.562888    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3864dce7-cea7-4c15-8605-3ae4cef7292a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.663731 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.663641    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvff9\" (UniqueName: \"kubernetes.io/projected/b33e7842-85db-4429-aa1f-25a51b844d64-kube-api-access-mvff9\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.663731 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.663715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e7842-85db-4429-aa1f-25a51b844d64-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.663930 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.663767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtkl2\" (UniqueName: \"kubernetes.io/projected/3864dce7-cea7-4c15-8605-3ae4cef7292a-kube-api-access-qtkl2\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.663930 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.663838    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3864dce7-cea7-4c15-8605-3ae4cef7292a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.664716 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.664697    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3864dce7-cea7-4c15-8605-3ae4cef7292a-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.672247 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.672214    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtkl2\" (UniqueName: \"kubernetes.io/projected/3864dce7-cea7-4c15-8605-3ae4cef7292a-kube-api-access-qtkl2\") pod \"payload-pre-processing-687dbb6cf6-kjs6n\" (UID: \"3864dce7-cea7-4c15-8605-3ae4cef7292a\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.765148 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.765113    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e7842-85db-4429-aa1f-25a51b844d64-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.765376 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.765219    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvff9\" (UniqueName: \"kubernetes.io/projected/b33e7842-85db-4429-aa1f-25a51b844d64-kube-api-access-mvff9\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.765851 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.765828    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b33e7842-85db-4429-aa1f-25a51b844d64-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.776328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.776294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvff9\" (UniqueName: \"kubernetes.io/projected/b33e7842-85db-4429-aa1f-25a51b844d64-kube-api-access-mvff9\") pod \"payload-processing-5cc6cd444b-dglr4\" (UID: \"b33e7842-85db-4429-aa1f-25a51b844d64\") " pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.819346 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.819304    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:30.859239 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.859186    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:30.969470 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:30.969434    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"]
Jul 29 18:03:30.972863 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:03:30.972833    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3864dce7_cea7_4c15_8605_3ae4cef7292a.slice/crio-79747cc9c4b9402215fc436271f93eed32f60e115ad02166b642b25bc5cc6ec6 WatchSource:0}: Error finding container 79747cc9c4b9402215fc436271f93eed32f60e115ad02166b642b25bc5cc6ec6: Status 404 returned error can't find the container with id 79747cc9c4b9402215fc436271f93eed32f60e115ad02166b642b25bc5cc6ec6
Jul 29 18:03:31.016505 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:31.016481    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-dglr4"]
Jul 29 18:03:31.019340 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:03:31.019306    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33e7842_85db_4429_aa1f_25a51b844d64.slice/crio-aa9e70496af900865d339cba7c5d644232e9b4e4377553b611615ddc24aa5b2f WatchSource:0}: Error finding container aa9e70496af900865d339cba7c5d644232e9b4e4377553b611615ddc24aa5b2f: Status 404 returned error can't find the container with id aa9e70496af900865d339cba7c5d644232e9b4e4377553b611615ddc24aa5b2f
Jul 29 18:03:31.589513 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:31.589478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4" event={"ID":"b33e7842-85db-4429-aa1f-25a51b844d64","Type":"ContainerStarted","Data":"aa9e70496af900865d339cba7c5d644232e9b4e4377553b611615ddc24aa5b2f"}
Jul 29 18:03:31.589995 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:31.589538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n" event={"ID":"3864dce7-cea7-4c15-8605-3ae4cef7292a","Type":"ContainerStarted","Data":"79747cc9c4b9402215fc436271f93eed32f60e115ad02166b642b25bc5cc6ec6"}
Jul 29 18:03:33.598318 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.598264    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n" event={"ID":"3864dce7-cea7-4c15-8605-3ae4cef7292a","Type":"ContainerStarted","Data":"6baa1559e338d0fe9ed8246bd0c144bef357d6373f3fbf12b812397f365308aa"}
Jul 29 18:03:33.598814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.598336    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:33.599848 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.599819    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4" event={"ID":"b33e7842-85db-4429-aa1f-25a51b844d64","Type":"ContainerStarted","Data":"0c3cefb9dd5599c5a0591287f3558a50c8df4a833b5130c12c2cb2f2a383041e"}
Jul 29 18:03:33.599968 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.599925    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:03:33.613889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.613834    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n" podStartSLOduration=1.954931711 podStartE2EDuration="3.613815298s" totalImagesPullingTime="1.658883587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:03:33.613000124 +0000 UTC m=+636.586042329" watchObservedRunningTime="2026-07-29 18:03:33.613815298 +0000 UTC m=+636.586857478"
Jul 29 18:03:33.629734 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:33.629683    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4" podStartSLOduration=2.010020314 podStartE2EDuration="3.629665253s" totalImagesPullingTime="1.619644939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:03:33.628166634 +0000 UTC m=+636.601208836" watchObservedRunningTime="2026-07-29 18:03:33.629665253 +0000 UTC m=+636.602707432"
Jul 29 18:03:40.751789 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:40.751751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:40.841666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:40.841635    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:03:44.606777 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:44.606746    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-kjs6n"
Jul 29 18:03:44.607217 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:03:44.606819    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-dglr4"
Jul 29 18:04:01.110944 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:01.110907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:05.133227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.133175    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"]
Jul 29 18:04:05.142239 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.142203    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.145237 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.145212    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 18:04:05.145383 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.145239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-68jvk\""
Jul 29 18:04:05.146256 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.146235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 18:04:05.146307 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.146292    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 18:04:05.152124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.152099    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"]
Jul 29 18:04:05.160018 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.159981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.160223 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.160032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw9fz\" (UniqueName: \"kubernetes.io/projected/42a17083-f62b-4850-a776-87ca8152ee99-kube-api-access-vw9fz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.160223 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.160076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.160223 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.160102    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.160223 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.160126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.160412 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.160227    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a17083-f62b-4850-a776-87ca8152ee99-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.180792 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.180754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:05.260869 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.260826    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261091 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.260883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261091 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.260918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261091 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.260954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a17083-f62b-4850-a776-87ca8152ee99-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261091 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.261043    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261342 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.261099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw9fz\" (UniqueName: \"kubernetes.io/projected/42a17083-f62b-4850-a776-87ca8152ee99-kube-api-access-vw9fz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261342 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.261318    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.261874 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.261849    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.262055 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.261856    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.264031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.264005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/42a17083-f62b-4850-a776-87ca8152ee99-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.264293 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.264276    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42a17083-f62b-4850-a776-87ca8152ee99-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.270988 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.270957    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw9fz\" (UniqueName: \"kubernetes.io/projected/42a17083-f62b-4850-a776-87ca8152ee99-kube-api-access-vw9fz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qxsj4\" (UID: \"42a17083-f62b-4850-a776-87ca8152ee99\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.454403 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.454300    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:05.604880 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.604854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"]
Jul 29 18:04:05.607551 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:04:05.607522    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a17083_f62b_4850_a776_87ca8152ee99.slice/crio-c56864d40938b2b6a603b43b5cc23f2d742e07eb79952370e3ce99eff34ab2a6 WatchSource:0}: Error finding container c56864d40938b2b6a603b43b5cc23f2d742e07eb79952370e3ce99eff34ab2a6: Status 404 returned error can't find the container with id c56864d40938b2b6a603b43b5cc23f2d742e07eb79952370e3ce99eff34ab2a6
Jul 29 18:04:05.609347 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.609326    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 18:04:05.756396 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:05.756299    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4" event={"ID":"42a17083-f62b-4850-a776-87ca8152ee99","Type":"ContainerStarted","Data":"c56864d40938b2b6a603b43b5cc23f2d742e07eb79952370e3ce99eff34ab2a6"}
Jul 29 18:04:06.764273 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:06.764232    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4" event={"ID":"42a17083-f62b-4850-a776-87ca8152ee99","Type":"ContainerStarted","Data":"43c2bfaa17a494315666524186433218ec9ed8b7d8a8095da3bce1f90bbdf2cc"}
Jul 29 18:04:06.783382 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:06.783308    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4" podStartSLOduration=0.766471198 podStartE2EDuration="1.783283327s" totalImagesPullingTime="1.016812129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:04:06.782301979 +0000 UTC m=+669.755344160" watchObservedRunningTime="2026-07-29 18:04:06.783283327 +0000 UTC m=+669.756325508"
Jul 29 18:04:10.710696 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:10.710656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:15.454727 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:15.454685    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:15.455147 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:15.454784    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:15.470265 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:15.470231    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:15.820547 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:15.820459    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qxsj4"
Jul 29 18:04:18.758739 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:18.758701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:22.223733 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:22.223688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:33.964309 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:33.964275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:39.928510 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:39.928479    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"]
Jul 29 18:04:39.931241 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:39.931226    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:39.934154 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:39.934131    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 18:04:39.941425 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:39.941395    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"]
Jul 29 18:04:40.024955 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.024923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:40.086281 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.086281 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086280    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxwc\" (UniqueName: \"kubernetes.io/projected/91139ff1-200e-4d92-a179-3e66e30c3670-kube-api-access-6sxwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.086493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086312    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.086493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.086493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.086493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.086462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91139ff1-200e-4d92-a179-3e66e30c3670-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187565    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187616    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187743    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91139ff1-200e-4d92-a179-3e66e30c3670-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187835    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxwc\" (UniqueName: \"kubernetes.io/projected/91139ff1-200e-4d92-a179-3e66e30c3670-kube-api-access-6sxwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187918    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.187956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.187948    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.188228 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.188011    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.188228 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.188212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.189947 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.189920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/91139ff1-200e-4d92-a179-3e66e30c3670-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.190207 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.190180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/91139ff1-200e-4d92-a179-3e66e30c3670-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.196539 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.196514    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxwc\" (UniqueName: \"kubernetes.io/projected/91139ff1-200e-4d92-a179-3e66e30c3670-kube-api-access-6sxwc\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-p4g75\" (UID: \"91139ff1-200e-4d92-a179-3e66e30c3670\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.241737 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.241696    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:40.386488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.386464    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"]
Jul 29 18:04:40.388306 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:04:40.388278    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91139ff1_200e_4d92_a179_3e66e30c3670.slice/crio-f5c1e2289afc7f3dbe8fa78207a24dd497a9df71995c8304dd68c4494a3eb9d5 WatchSource:0}: Error finding container f5c1e2289afc7f3dbe8fa78207a24dd497a9df71995c8304dd68c4494a3eb9d5: Status 404 returned error can't find the container with id f5c1e2289afc7f3dbe8fa78207a24dd497a9df71995c8304dd68c4494a3eb9d5
Jul 29 18:04:40.930803 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.930770    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75" event={"ID":"91139ff1-200e-4d92-a179-3e66e30c3670","Type":"ContainerStarted","Data":"c8ecb5572c036245d39aedf9f49123d315872d3d45eee22cd61dc1deb8e582b7"}
Jul 29 18:04:40.931236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.930818    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75" event={"ID":"91139ff1-200e-4d92-a179-3e66e30c3670","Type":"ContainerStarted","Data":"f5c1e2289afc7f3dbe8fa78207a24dd497a9df71995c8304dd68c4494a3eb9d5"}
Jul 29 18:04:40.949691 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:40.949634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75" podStartSLOduration=1.758576899 podStartE2EDuration="1.949615621s" totalImagesPullingTime="191.038722ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:04:40.947962387 +0000 UTC m=+703.921004567" watchObservedRunningTime="2026-07-29 18:04:40.949615621 +0000 UTC m=+703.922657796"
Jul 29 18:04:43.990006 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:43.989978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:04:50.242748 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:50.242652    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:50.242748 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:50.242725    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:50.255487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:50.255451    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:04:50.991100 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:04:50.991072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-p4g75"
Jul 29 18:05:26.432983 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:26.432950    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:05:26.534176 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:26.534147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:05:53.544245 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:53.544177    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:05:53.639526 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:53.639491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:05:54.699955 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:54.699914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:05:54.794521 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:05:54.794491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:06:08.285896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:06:08.285864    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:06:16.102163 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:06:16.102130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:06:33.790144 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:06:33.790060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:06:38.058919 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:06:38.058886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:07:57.738002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:07:57.737970    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:07:57.739042 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:07:57.739011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:07:57.741307 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:07:57.741287    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:07:57.742379 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:07:57.742361    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:07:58.845741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:07:58.845677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:00.070898 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:00.070865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:47.887554 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:47.887524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:51.683925 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:51.683890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:53.823076 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:53.823039    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:53.923508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:53.923472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:54.023072 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:54.023037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:54.167208 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:54.167174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:08:57.045802 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:08:57.045769    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:09:00.008598 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:09:00.008562    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:09:00.103119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:09:00.103051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:10:34.279261 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:10:34.279227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:10:34.367698 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:10:34.367664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:10:50.193099 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:10:50.193017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:12:57.766850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:12:57.766761    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:12:57.769376 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:12:57.769351    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:12:57.770135 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:12:57.770113    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:12:57.772409 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:12:57.772388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:13:15.975707 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:15.975666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:13:16.064561 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:16.064527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:13:16.691970 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:16.691937    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:13:16.692236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:16.692186    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" podUID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" containerName="manager" containerID="cri-o://6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696" gracePeriod=10
Jul 29 18:13:20.359792 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.359764    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:13:20.444506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.444406    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" containerID="6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696" exitCode=0
Jul 29 18:13:20.444506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.444454    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"
Jul 29 18:13:20.444506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.444488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" event={"ID":"6ff32556-461b-4d7f-8d83-a5141ceac3d4","Type":"ContainerDied","Data":"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"}
Jul 29 18:13:20.444741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.444549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49" event={"ID":"6ff32556-461b-4d7f-8d83-a5141ceac3d4","Type":"ContainerDied","Data":"770e1490082ee3fb3cf80603ed7aa95e89b6dcaef9f83f60632de3c6241e1d7a"}
Jul 29 18:13:20.444741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.444577    2563 scope.go:117] "RemoveContainer" containerID="6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"
Jul 29 18:13:20.446231 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.446179    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bfvz\" (UniqueName: \"kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz\") pod \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") "
Jul 29 18:13:20.446379 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.446364    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume\") pod \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\" (UID: \"6ff32556-461b-4d7f-8d83-a5141ceac3d4\") "
Jul 29 18:13:20.446840 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.446802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6ff32556-461b-4d7f-8d83-a5141ceac3d4" (UID: "6ff32556-461b-4d7f-8d83-a5141ceac3d4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:13:20.448425 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.448405    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz" (OuterVolumeSpecName: "kube-api-access-4bfvz") pod "6ff32556-461b-4d7f-8d83-a5141ceac3d4" (UID: "6ff32556-461b-4d7f-8d83-a5141ceac3d4"). InnerVolumeSpecName "kube-api-access-4bfvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:13:20.461435 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.461413    2563 scope.go:117] "RemoveContainer" containerID="6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"
Jul 29 18:13:20.461720 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:13:20.461702    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696\": container with ID starting with 6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696 not found: ID does not exist" containerID="6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"
Jul 29 18:13:20.461772 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.461733    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696"} err="failed to get container status \"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696\": rpc error: code = NotFound desc = could not find container \"6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696\": container with ID starting with 6113b7f074348f68346ac2d90ff3787eeed7de8516dedd20f91a874db5e54696 not found: ID does not exist"
Jul 29 18:13:20.547155 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.547099    2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ff32556-461b-4d7f-8d83-a5141ceac3d4-extensions-socket-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:13:20.547155 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.547168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bfvz\" (UniqueName: \"kubernetes.io/projected/6ff32556-461b-4d7f-8d83-a5141ceac3d4-kube-api-access-4bfvz\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:13:20.766829 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.766791    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:13:20.770638 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:20.770606    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glz49"]
Jul 29 18:13:21.586085 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:21.586048    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" path="/var/lib/kubelet/pods/6ff32556-461b-4d7f-8d83-a5141ceac3d4/volumes"
Jul 29 18:13:46.597824 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:46.597791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:13:46.648326 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:13:46.648291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:14:17.789031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.788995    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"]
Jul 29 18:14:17.789519 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.789381    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" containerName="manager"
Jul 29 18:14:17.789519 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.789392    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" containerName="manager"
Jul 29 18:14:17.789519 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.789454    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ff32556-461b-4d7f-8d83-a5141ceac3d4" containerName="manager"
Jul 29 18:14:17.793892 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.793867    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.796600 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.796577    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-vznvv\""
Jul 29 18:14:17.803593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.803559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"]
Jul 29 18:14:17.857545 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.857510    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zds\" (UniqueName: \"kubernetes.io/projected/3718d92f-8de9-4ce7-92f5-f60db94a43cc-kube-api-access-46zds\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.857740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.857572    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3718d92f-8de9-4ce7-92f5-f60db94a43cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.958993 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.958943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3718d92f-8de9-4ce7-92f5-f60db94a43cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.959240 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.959060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46zds\" (UniqueName: \"kubernetes.io/projected/3718d92f-8de9-4ce7-92f5-f60db94a43cc-kube-api-access-46zds\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.959385 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.959364    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3718d92f-8de9-4ce7-92f5-f60db94a43cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:17.968909 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:17.968877    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zds\" (UniqueName: \"kubernetes.io/projected/3718d92f-8de9-4ce7-92f5-f60db94a43cc-kube-api-access-46zds\") pod \"kuadrant-operator-controller-manager-86878c769f-5d8hf\" (UID: \"3718d92f-8de9-4ce7-92f5-f60db94a43cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:18.104805 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.104772    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:18.251553 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.251523    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"]
Jul 29 18:14:18.253580 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:14:18.253546    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3718d92f_8de9_4ce7_92f5_f60db94a43cc.slice/crio-b24584357a4a47b7e88f9768caa8b1392d603c75e70a7039f4dbdbf235704ee7 WatchSource:0}: Error finding container b24584357a4a47b7e88f9768caa8b1392d603c75e70a7039f4dbdbf235704ee7: Status 404 returned error can't find the container with id b24584357a4a47b7e88f9768caa8b1392d603c75e70a7039f4dbdbf235704ee7
Jul 29 18:14:18.723275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.723239    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf" event={"ID":"3718d92f-8de9-4ce7-92f5-f60db94a43cc","Type":"ContainerStarted","Data":"9488ba2c2b4bf98202cc517cd14abee1c4c430405f5dfe0ea94be50cea827a79"}
Jul 29 18:14:18.723462 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.723413    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:14:18.723462 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.723453    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf" event={"ID":"3718d92f-8de9-4ce7-92f5-f60db94a43cc","Type":"ContainerStarted","Data":"b24584357a4a47b7e88f9768caa8b1392d603c75e70a7039f4dbdbf235704ee7"}
Jul 29 18:14:18.743871 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:18.743801    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf" podStartSLOduration=1.7437771130000002 podStartE2EDuration="1.743777113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:14:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:14:18.743229514 +0000 UTC m=+1281.716271717" watchObservedRunningTime="2026-07-29 18:14:18.743777113 +0000 UTC m=+1281.716819294"
Jul 29 18:14:29.731246 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:14:29.731188    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5d8hf"
Jul 29 18:15:46.089653 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:15:46.089613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:15:47.563883 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:15:47.563844    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:16:27.441105 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:16:27.441074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:17:17.153492 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:17.153444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:17:19.713937 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.713899    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:17:19.717487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.717470    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.720061 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.720038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-86953ea5-kserve-self-signed-certs\""
Jul 29 18:17:19.725893 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.725870    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:17:19.733477 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733446    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.733621 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhmr8\" (UniqueName: \"kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.733621 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.733730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733621    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.733730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733644    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.733730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.733688    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.738969 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.738932    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:17:19.834606 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.834814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.834814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834674    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhmr8\" (UniqueName: \"kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.834814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.834814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.834814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.834757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.835099 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.835034    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.835099 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.835086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.835181 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.835123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.837107 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.837082    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.837284 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.837267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:19.842078 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:19.842049    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhmr8\" (UniqueName: \"kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8\") pod \"e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") " pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:20.027312 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:20.027204    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:20.174844 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:20.174817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:17:20.177392 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:17:20.177364    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dd46b93_fa96_4f99_a2f6_9faff1204d7a.slice/crio-b0e15724ae1ab9a7772fea8a2fecb95c05999902c41badb4303131ae3c1656a4 WatchSource:0}: Error finding container b0e15724ae1ab9a7772fea8a2fecb95c05999902c41badb4303131ae3c1656a4: Status 404 returned error can't find the container with id b0e15724ae1ab9a7772fea8a2fecb95c05999902c41badb4303131ae3c1656a4
Jul 29 18:17:20.592712 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:20.592670    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" event={"ID":"9dd46b93-fa96-4f99-a2f6-9faff1204d7a","Type":"ContainerStarted","Data":"617d770532015039263d5ced258281e32a1cdfa2eacf684670cce78da318515f"}
Jul 29 18:17:20.592712 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:20.592710    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" event={"ID":"9dd46b93-fa96-4f99-a2f6-9faff1204d7a","Type":"ContainerStarted","Data":"b0e15724ae1ab9a7772fea8a2fecb95c05999902c41badb4303131ae3c1656a4"}
Jul 29 18:17:20.610654 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:20.610600    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" podStartSLOduration=1.6105797050000001 podStartE2EDuration="1.610579705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:17:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:17:20.608787666 +0000 UTC m=+1463.581829871" watchObservedRunningTime="2026-07-29 18:17:20.610579705 +0000 UTC m=+1463.583621885"
Jul 29 18:17:30.028125 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:30.028083    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:30.028624 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:30.028147    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:30.041313 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:30.041280    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:30.652811 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:30.652782    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:17:57.795527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:57.795493    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:17:57.798493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:57.798467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:17:57.799641 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:57.799623    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:17:57.802550 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:17:57.802527    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:18:01.909528 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:01.909492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:18:02.720455 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:02.720409    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:18:02.739185 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:02.739152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:18:17.741134 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:17.741095    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" podUID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" containerName="main" containerID="cri-o://617d770532015039263d5ced258281e32a1cdfa2eacf684670cce78da318515f" gracePeriod=45
Jul 29 18:18:17.876225 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:17.874530    2563 generic.go:356] "Generic (PLEG): container finished" podID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" containerID="617d770532015039263d5ced258281e32a1cdfa2eacf684670cce78da318515f" exitCode=0
Jul 29 18:18:17.876225 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:17.874675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" event={"ID":"9dd46b93-fa96-4f99-a2f6-9faff1204d7a","Type":"ContainerDied","Data":"617d770532015039263d5ced258281e32a1cdfa2eacf684670cce78da318515f"}
Jul 29 18:18:18.013063 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.013029    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:18:18.064416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064475    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064528    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhmr8\" (UniqueName: \"kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064596    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064620    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache\") pod \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\" (UID: \"9dd46b93-fa96-4f99-a2f6-9faff1204d7a\") "
Jul 29 18:18:18.064867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.064802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home" (OuterVolumeSpecName: "home") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:18.065076 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.065052    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-home\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.065174 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.065092    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:18.065420 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.065388    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:18.066980 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.066944    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm" (OuterVolumeSpecName: "dshm") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 18:18:18.067132 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.067104    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8" (OuterVolumeSpecName: "kube-api-access-mhmr8") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "kube-api-access-mhmr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:18:18.067313 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.067127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9dd46b93-fa96-4f99-a2f6-9faff1204d7a" (UID: "9dd46b93-fa96-4f99-a2f6-9faff1204d7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 18:18:18.166101 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.166064    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhmr8\" (UniqueName: \"kubernetes.io/projected/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-kube-api-access-mhmr8\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.166306 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.166118    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tmp-dir\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.166306 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.166130    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-dshm\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.166306 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.166140    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-model-cache\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.166306 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.166148    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9dd46b93-fa96-4f99-a2f6-9faff1204d7a-tls-certs\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:18:18.880686 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.880658    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"
Jul 29 18:18:18.881119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.880698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2" event={"ID":"9dd46b93-fa96-4f99-a2f6-9faff1204d7a","Type":"ContainerDied","Data":"b0e15724ae1ab9a7772fea8a2fecb95c05999902c41badb4303131ae3c1656a4"}
Jul 29 18:18:18.881119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.880748    2563 scope.go:117] "RemoveContainer" containerID="617d770532015039263d5ced258281e32a1cdfa2eacf684670cce78da318515f"
Jul 29 18:18:18.903258 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.903223    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:18:18.905246 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:18.905219    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-86953ea5-kserve-5b5747b67-4szr2"]
Jul 29 18:18:19.586091 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:18:19.586050    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" path="/var/lib/kubelet/pods/9dd46b93-fa96-4f99-a2f6-9faff1204d7a/volumes"
Jul 29 18:21:19.097910 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:19.097865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:39.696738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:39.696700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:42.742134 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:42.742100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:42.845657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:42.845618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:43.191927 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:43.191893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:48.833790 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:48.833758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:48.909969 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:48.909936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:49.069613 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:49.069578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:49.344902 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:49.344870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:49.492366 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:49.492336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:51.912398 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:51.912361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:52.008618 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:52.008585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:53.008015 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.007984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:53.191722 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.191688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:53.512360 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.512321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:53.604593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.604540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:21:53.614635 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.614605    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:21:53.614975 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.614963    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" containerName="main"
Jul 29 18:21:53.615027 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.614976    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" containerName="main"
Jul 29 18:21:53.615064 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.615051    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd46b93-fa96-4f99-a2f6-9faff1204d7a" containerName="main"
Jul 29 18:21:53.617966 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.617939    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.622485 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.622462    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-a1d6b581\""
Jul 29 18:21:53.630001 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.629972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:21:53.632625 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.632602    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:21:53.635933 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.635912    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.638823 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.638800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-a1d6b581-dockercfg-wng9z\""
Jul 29 18:21:53.645502 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.645458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:21:53.675713 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.675665    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntb9n\" (UniqueName: \"kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.675894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.675724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.675894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.675778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.675894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.675867    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.776699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.776598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntb9n\" (UniqueName: \"kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.776699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.776644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.776699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.776689    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.777017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.776725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.777450 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.777423    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.777552 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.777465    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.785669 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.785643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r\") pod \"payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") " pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:53.785786 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.785709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntb9n\" (UniqueName: \"kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n\") pod \"payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.930016 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.929978    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:53.949154 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:53.949112    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:54.094460 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.094430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:21:54.096271 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:21:54.096244    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75b649fb_eae1_4005_9d28_0055671f09e9.slice/crio-7210a698d5ff2add1ed6d662c4a02a723cc0f584a6d7d4d5ff853e2b0fa06eae WatchSource:0}: Error finding container 7210a698d5ff2add1ed6d662c4a02a723cc0f584a6d7d4d5ff853e2b0fa06eae: Status 404 returned error can't find the container with id 7210a698d5ff2add1ed6d662c4a02a723cc0f584a6d7d4d5ff853e2b0fa06eae
Jul 29 18:21:54.121917 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.121893    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:21:54.124851 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:21:54.124812    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dda3589_a46f_4a2e_861b_98fd636154a0.slice/crio-247af95c3dce8b8146957b17d62789a4d051081d1513d03115c75214f6233af5 WatchSource:0}: Error finding container 247af95c3dce8b8146957b17d62789a4d051081d1513d03115c75214f6233af5: Status 404 returned error can't find the container with id 247af95c3dce8b8146957b17d62789a4d051081d1513d03115c75214f6233af5
Jul 29 18:21:54.937644 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.937602    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" event={"ID":"75b649fb-eae1-4005-9d28-0055671f09e9","Type":"ContainerStarted","Data":"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"}
Jul 29 18:21:54.937860 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.937660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" event={"ID":"75b649fb-eae1-4005-9d28-0055671f09e9","Type":"ContainerStarted","Data":"7210a698d5ff2add1ed6d662c4a02a723cc0f584a6d7d4d5ff853e2b0fa06eae"}
Jul 29 18:21:54.937860 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.937779    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:21:54.939258 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.939229    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" event={"ID":"5dda3589-a46f-4a2e-861b-98fd636154a0","Type":"ContainerStarted","Data":"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"}
Jul 29 18:21:54.939362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.939278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" event={"ID":"5dda3589-a46f-4a2e-861b-98fd636154a0","Type":"ContainerStarted","Data":"247af95c3dce8b8146957b17d62789a4d051081d1513d03115c75214f6233af5"}
Jul 29 18:21:54.939362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.939318    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:21:54.954960 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.954904    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" podStartSLOduration=1.95488665 podStartE2EDuration="1.95488665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:21:54.953751966 +0000 UTC m=+1737.926794150" watchObservedRunningTime="2026-07-29 18:21:54.95488665 +0000 UTC m=+1737.927928890"
Jul 29 18:21:54.969762 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:21:54.969700    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" podStartSLOduration=1.96968187 podStartE2EDuration="1.96968187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:21:54.967921904 +0000 UTC m=+1737.940964088" watchObservedRunningTime="2026-07-29 18:21:54.96968187 +0000 UTC m=+1737.942724050"
Jul 29 18:22:05.946712 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:05.946682    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:22:05.947142 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:05.946751    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:22:20.824536 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:20.824503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.517290 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.517251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.549517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.549479    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:22:23.549777 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.549749    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" podUID="5dda3589-a46f-4a2e-861b-98fd636154a0" containerName="payload-processing" containerID="cri-o://1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca" gracePeriod=30
Jul 29 18:22:23.556816 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.556784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:22:23.557038 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.557014    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" podUID="75b649fb-eae1-4005-9d28-0055671f09e9" containerName="payload-pre-processing" containerID="cri-o://184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86" gracePeriod=30
Jul 29 18:22:23.592525 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.592490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.669654 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.669620    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.741645 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.741574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.843548 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.843519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:23.863715 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.863686    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:22:23.867051 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.867022    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:22:23.953228 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953162    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntb9n\" (UniqueName: \"kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n\") pod \"75b649fb-eae1-4005-9d28-0055671f09e9\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") "
Jul 29 18:22:23.953441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953269    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r\") pod \"5dda3589-a46f-4a2e-861b-98fd636154a0\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") "
Jul 29 18:22:23.953441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953300    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume\") pod \"5dda3589-a46f-4a2e-861b-98fd636154a0\" (UID: \"5dda3589-a46f-4a2e-861b-98fd636154a0\") "
Jul 29 18:22:23.953441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume\") pod \"75b649fb-eae1-4005-9d28-0055671f09e9\" (UID: \"75b649fb-eae1-4005-9d28-0055671f09e9\") "
Jul 29 18:22:23.953878 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953729    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5dda3589-a46f-4a2e-861b-98fd636154a0" (UID: "5dda3589-a46f-4a2e-861b-98fd636154a0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:22:23.954020 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.953913    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75b649fb-eae1-4005-9d28-0055671f09e9" (UID: "75b649fb-eae1-4005-9d28-0055671f09e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:22:23.955620 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.955592    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r" (OuterVolumeSpecName: "kube-api-access-k2d8r") pod "5dda3589-a46f-4a2e-861b-98fd636154a0" (UID: "5dda3589-a46f-4a2e-861b-98fd636154a0"). InnerVolumeSpecName "kube-api-access-k2d8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:22:23.955745 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:23.955722    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n" (OuterVolumeSpecName: "kube-api-access-ntb9n") pod "75b649fb-eae1-4005-9d28-0055671f09e9" (UID: "75b649fb-eae1-4005-9d28-0055671f09e9"). InnerVolumeSpecName "kube-api-access-ntb9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:22:24.052589 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.052503    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:24.054337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.054297    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntb9n\" (UniqueName: \"kubernetes.io/projected/75b649fb-eae1-4005-9d28-0055671f09e9-kube-api-access-ntb9n\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:22:24.054337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.054328    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2d8r\" (UniqueName: \"kubernetes.io/projected/5dda3589-a46f-4a2e-861b-98fd636154a0-kube-api-access-k2d8r\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:22:24.054337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.054341    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dda3589-a46f-4a2e-861b-98fd636154a0-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:22:24.054542 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.054355    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75b649fb-eae1-4005-9d28-0055671f09e9-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:22:24.085351 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.085314    2563 generic.go:356] "Generic (PLEG): container finished" podID="75b649fb-eae1-4005-9d28-0055671f09e9" containerID="184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86" exitCode=0
Jul 29 18:22:24.085543 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.085394    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"
Jul 29 18:22:24.085543 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.085396    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" event={"ID":"75b649fb-eae1-4005-9d28-0055671f09e9","Type":"ContainerDied","Data":"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"}
Jul 29 18:22:24.085543 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.085514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj" event={"ID":"75b649fb-eae1-4005-9d28-0055671f09e9","Type":"ContainerDied","Data":"7210a698d5ff2add1ed6d662c4a02a723cc0f584a6d7d4d5ff853e2b0fa06eae"}
Jul 29 18:22:24.085721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.085567    2563 scope.go:117] "RemoveContainer" containerID="184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"
Jul 29 18:22:24.086970 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.086947    2563 generic.go:356] "Generic (PLEG): container finished" podID="5dda3589-a46f-4a2e-861b-98fd636154a0" containerID="1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca" exitCode=0
Jul 29 18:22:24.087108 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.087015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"
Jul 29 18:22:24.087233 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.087014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" event={"ID":"5dda3589-a46f-4a2e-861b-98fd636154a0","Type":"ContainerDied","Data":"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"}
Jul 29 18:22:24.087377 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.087359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h" event={"ID":"5dda3589-a46f-4a2e-861b-98fd636154a0","Type":"ContainerDied","Data":"247af95c3dce8b8146957b17d62789a4d051081d1513d03115c75214f6233af5"}
Jul 29 18:22:24.096000 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.095974    2563 scope.go:117] "RemoveContainer" containerID="184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"
Jul 29 18:22:24.096394 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:22:24.096359    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86\": container with ID starting with 184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86 not found: ID does not exist" containerID="184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"
Jul 29 18:22:24.096517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.096405    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86"} err="failed to get container status \"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86\": rpc error: code = NotFound desc = could not find container \"184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86\": container with ID starting with 184180241c8c1a191c50b171c06d6a8f59b1bc100e6214805f2274a4f2563d86 not found: ID does not exist"
Jul 29 18:22:24.096517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.096430    2563 scope.go:117] "RemoveContainer" containerID="1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"
Jul 29 18:22:24.105261 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.105241    2563 scope.go:117] "RemoveContainer" containerID="1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"
Jul 29 18:22:24.105555 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:22:24.105536    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca\": container with ID starting with 1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca not found: ID does not exist" containerID="1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"
Jul 29 18:22:24.105621 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.105569    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca"} err="failed to get container status \"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca\": rpc error: code = NotFound desc = could not find container \"1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca\": container with ID starting with 1449166c7537e4d77ed0797a750a96c0182246bd5481b2c970b85882266983ca not found: ID does not exist"
Jul 29 18:22:24.112874 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.112849    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:22:24.116936 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.116913    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-a1d6b581-77b959d9bd-st5dj"]
Jul 29 18:22:24.132132 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.132094    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:22:24.135215 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.135161    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-a1d6b581-65f65df4dd-vpg2h"]
Jul 29 18:22:24.293944 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.293907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:24.397924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.397892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:24.496027 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.495999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:24.777227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.777114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:24.954744 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:24.954702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:25.589455 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:25.589420    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dda3589-a46f-4a2e-861b-98fd636154a0" path="/var/lib/kubelet/pods/5dda3589-a46f-4a2e-861b-98fd636154a0/volumes"
Jul 29 18:22:25.589807 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:25.589795    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75b649fb-eae1-4005-9d28-0055671f09e9" path="/var/lib/kubelet/pods/75b649fb-eae1-4005-9d28-0055671f09e9/volumes"
Jul 29 18:22:26.290139 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:26.290108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.037227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.037174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.277986 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.277947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.654527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.654489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.759289 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.759251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.843249 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.843181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:22:30.844022 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.843998    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:22:30.844437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844421    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75b649fb-eae1-4005-9d28-0055671f09e9" containerName="payload-pre-processing"
Jul 29 18:22:30.844531 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844439    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75b649fb-eae1-4005-9d28-0055671f09e9" containerName="payload-pre-processing"
Jul 29 18:22:30.844531 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844485    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dda3589-a46f-4a2e-861b-98fd636154a0" containerName="payload-processing"
Jul 29 18:22:30.844531 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844494    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dda3589-a46f-4a2e-861b-98fd636154a0" containerName="payload-processing"
Jul 29 18:22:30.844686 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844587    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dda3589-a46f-4a2e-861b-98fd636154a0" containerName="payload-processing"
Jul 29 18:22:30.844686 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.844601    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="75b649fb-eae1-4005-9d28-0055671f09e9" containerName="payload-pre-processing"
Jul 29 18:22:30.847643 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.847624    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:30.850412 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.850390    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-38933e69\""
Jul 29 18:22:30.850508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.850458    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-38933e69-dockercfg-f2hjg\""
Jul 29 18:22:30.858446 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.858418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:22:30.894051 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.894019    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:22:30.897403 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.897384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:30.909099 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:30.909025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:22:31.024263 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.024185    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c5kc\" (UniqueName: \"kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.024483 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.024411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g22tf\" (UniqueName: \"kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.024483 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.024453    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.024604 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.024502    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.125291 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.125252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g22tf\" (UniqueName: \"kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.125291 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.125295    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.125767 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.125317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.125767 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.125352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c5kc\" (UniqueName: \"kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.126065 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.126045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.126103 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.126068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.133214 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.133157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g22tf\" (UniqueName: \"kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf\") pod \"payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") " pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.133214 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.133165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c5kc\" (UniqueName: \"kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc\") pod \"payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.159794 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.159693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:31.208391 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.208344    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:31.337604 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.337567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:22:31.339596 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:22:31.339565    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde16f94e_dcaa_48f1_9d78_3e10105e08f8.slice/crio-1f0ca273a4474b2ca66a9997ba800958347d0c8801eccd7eb3175fe248b53bb8 WatchSource:0}: Error finding container 1f0ca273a4474b2ca66a9997ba800958347d0c8801eccd7eb3175fe248b53bb8: Status 404 returned error can't find the container with id 1f0ca273a4474b2ca66a9997ba800958347d0c8801eccd7eb3175fe248b53bb8
Jul 29 18:22:31.592420 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:31.592399    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:22:31.594374 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:22:31.594347    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b79d290_40a7_41fb_a6d7_db069215f678.slice/crio-c4c90e45918f0dce753f4cd377bf23dad8a6b903a0b282161e0024db007630da WatchSource:0}: Error finding container c4c90e45918f0dce753f4cd377bf23dad8a6b903a0b282161e0024db007630da: Status 404 returned error can't find the container with id c4c90e45918f0dce753f4cd377bf23dad8a6b903a0b282161e0024db007630da
Jul 29 18:22:32.131594 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.131558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" event={"ID":"de16f94e-dcaa-48f1-9d78-3e10105e08f8","Type":"ContainerStarted","Data":"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"}
Jul 29 18:22:32.132072 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.131615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" event={"ID":"de16f94e-dcaa-48f1-9d78-3e10105e08f8","Type":"ContainerStarted","Data":"1f0ca273a4474b2ca66a9997ba800958347d0c8801eccd7eb3175fe248b53bb8"}
Jul 29 18:22:32.132072 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.131739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:32.133354 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.133319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" event={"ID":"1b79d290-40a7-41fb-a6d7-db069215f678","Type":"ContainerStarted","Data":"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"}
Jul 29 18:22:32.133512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.133378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" event={"ID":"1b79d290-40a7-41fb-a6d7-db069215f678","Type":"ContainerStarted","Data":"c4c90e45918f0dce753f4cd377bf23dad8a6b903a0b282161e0024db007630da"}
Jul 29 18:22:32.133512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.133405    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:32.147760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.147709    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" podStartSLOduration=2.147692793 podStartE2EDuration="2.147692793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:22:32.147006735 +0000 UTC m=+1775.120048916" watchObservedRunningTime="2026-07-29 18:22:32.147692793 +0000 UTC m=+1775.120734973"
Jul 29 18:22:32.162865 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:32.162799    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" podStartSLOduration=2.162776228 podStartE2EDuration="2.162776228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:22:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:22:32.162645523 +0000 UTC m=+1775.135687723" watchObservedRunningTime="2026-07-29 18:22:32.162776228 +0000 UTC m=+1775.135818410"
Jul 29 18:22:43.141814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:43.141778    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:22:43.142238 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:43.141868    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:22:57.823381 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:57.823349    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:22:57.826486 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:57.826460    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:22:57.828491 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:57.828466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:22:57.831321 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:22:57.831297    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:23:01.459788 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.459756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:01.486171 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.486131    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:23:01.486739 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.486514    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" podUID="1b79d290-40a7-41fb-a6d7-db069215f678" containerName="payload-processing" containerID="cri-o://395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77" gracePeriod=30
Jul 29 18:23:01.492157 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.492064    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:23:01.492504 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.492408    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" podUID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" containerName="payload-pre-processing" containerID="cri-o://c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56" gracePeriod=30
Jul 29 18:23:01.525507 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.525482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:01.598102 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.598061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:01.656107 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.656006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:01.776544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.776513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:01.797417 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.797392    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:23:01.799759 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.799737    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:23:01.898397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898351    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8c5kc\" (UniqueName: \"kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc\") pod \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") "
Jul 29 18:23:01.898609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898456    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume\") pod \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\" (UID: \"de16f94e-dcaa-48f1-9d78-3e10105e08f8\") "
Jul 29 18:23:01.898609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume\") pod \"1b79d290-40a7-41fb-a6d7-db069215f678\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") "
Jul 29 18:23:01.898609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g22tf\" (UniqueName: \"kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf\") pod \"1b79d290-40a7-41fb-a6d7-db069215f678\" (UID: \"1b79d290-40a7-41fb-a6d7-db069215f678\") "
Jul 29 18:23:01.898896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898874    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b79d290-40a7-41fb-a6d7-db069215f678" (UID: "1b79d290-40a7-41fb-a6d7-db069215f678"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:23:01.898957 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.898885    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de16f94e-dcaa-48f1-9d78-3e10105e08f8" (UID: "de16f94e-dcaa-48f1-9d78-3e10105e08f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:23:01.900579 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.900556    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc" (OuterVolumeSpecName: "kube-api-access-8c5kc") pod "de16f94e-dcaa-48f1-9d78-3e10105e08f8" (UID: "de16f94e-dcaa-48f1-9d78-3e10105e08f8"). InnerVolumeSpecName "kube-api-access-8c5kc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:23:01.900656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:01.900614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf" (OuterVolumeSpecName: "kube-api-access-g22tf") pod "1b79d290-40a7-41fb-a6d7-db069215f678" (UID: "1b79d290-40a7-41fb-a6d7-db069215f678"). InnerVolumeSpecName "kube-api-access-g22tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:23:02.000175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.000132    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g22tf\" (UniqueName: \"kubernetes.io/projected/1b79d290-40a7-41fb-a6d7-db069215f678-kube-api-access-g22tf\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:02.000175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.000168    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8c5kc\" (UniqueName: \"kubernetes.io/projected/de16f94e-dcaa-48f1-9d78-3e10105e08f8-kube-api-access-8c5kc\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:02.000175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.000178    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de16f94e-dcaa-48f1-9d78-3e10105e08f8-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:02.000447 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.000186    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b79d290-40a7-41fb-a6d7-db069215f678-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:02.003616 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.003583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:02.222838 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.222803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:02.290331 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.290298    2563 generic.go:356] "Generic (PLEG): container finished" podID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" containerID="c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56" exitCode=0
Jul 29 18:23:02.290511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.290336    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"
Jul 29 18:23:02.290511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.290383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" event={"ID":"de16f94e-dcaa-48f1-9d78-3e10105e08f8","Type":"ContainerDied","Data":"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"}
Jul 29 18:23:02.290511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.290439    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk" event={"ID":"de16f94e-dcaa-48f1-9d78-3e10105e08f8","Type":"ContainerDied","Data":"1f0ca273a4474b2ca66a9997ba800958347d0c8801eccd7eb3175fe248b53bb8"}
Jul 29 18:23:02.290511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.290472    2563 scope.go:117] "RemoveContainer" containerID="c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"
Jul 29 18:23:02.291840 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.291819    2563 generic.go:356] "Generic (PLEG): container finished" podID="1b79d290-40a7-41fb-a6d7-db069215f678" containerID="395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77" exitCode=0
Jul 29 18:23:02.291988 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.291843    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" event={"ID":"1b79d290-40a7-41fb-a6d7-db069215f678","Type":"ContainerDied","Data":"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"}
Jul 29 18:23:02.291988 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.291876    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"
Jul 29 18:23:02.291988 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.291892    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9" event={"ID":"1b79d290-40a7-41fb-a6d7-db069215f678","Type":"ContainerDied","Data":"c4c90e45918f0dce753f4cd377bf23dad8a6b903a0b282161e0024db007630da"}
Jul 29 18:23:02.300527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.300501    2563 scope.go:117] "RemoveContainer" containerID="c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"
Jul 29 18:23:02.300832 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:23:02.300813    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56\": container with ID starting with c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56 not found: ID does not exist" containerID="c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"
Jul 29 18:23:02.300913 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.300845    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56"} err="failed to get container status \"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56\": rpc error: code = NotFound desc = could not find container \"c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56\": container with ID starting with c9906933fce4859cb31ed296582f75b66a5022daa84df91facf83571f9b0cc56 not found: ID does not exist"
Jul 29 18:23:02.300913 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.300864    2563 scope.go:117] "RemoveContainer" containerID="395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"
Jul 29 18:23:02.309881 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.309863    2563 scope.go:117] "RemoveContainer" containerID="395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"
Jul 29 18:23:02.310154 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:23:02.310135    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77\": container with ID starting with 395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77 not found: ID does not exist" containerID="395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"
Jul 29 18:23:02.310223 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.310163    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77"} err="failed to get container status \"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77\": rpc error: code = NotFound desc = could not find container \"395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77\": container with ID starting with 395ac8efe442c72ea97646617cd0e48cd7efc64d75c4ec4f5171f9e3ba42ad77 not found: ID does not exist"
Jul 29 18:23:02.315615 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.315591    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:23:02.319355 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.319332    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-38933e69-6c46f94d4-s4pgk"]
Jul 29 18:23:02.329482 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.329454    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:23:02.333112 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.333080    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-38933e69-7bc6969fc-rrtr9"]
Jul 29 18:23:02.533102 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.533062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:02.954816 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:02.954789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:03.587948 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:03.587915    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b79d290-40a7-41fb-a6d7-db069215f678" path="/var/lib/kubelet/pods/1b79d290-40a7-41fb-a6d7-db069215f678/volumes"
Jul 29 18:23:03.588343 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:03.588328    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" path="/var/lib/kubelet/pods/de16f94e-dcaa-48f1-9d78-3e10105e08f8/volumes"
Jul 29 18:23:05.102732 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:05.102693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:05.202513 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:05.202484    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:06.234615 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.234579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:06.697146 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.697107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:06.812254 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.812215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:06.910543 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.910513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:06.918545 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918512    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:06.918896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918884    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" containerName="payload-pre-processing"
Jul 29 18:23:06.918939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918898    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" containerName="payload-pre-processing"
Jul 29 18:23:06.918939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918906    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b79d290-40a7-41fb-a6d7-db069215f678" containerName="payload-processing"
Jul 29 18:23:06.918939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918912    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b79d290-40a7-41fb-a6d7-db069215f678" containerName="payload-processing"
Jul 29 18:23:06.919034 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918980    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b79d290-40a7-41fb-a6d7-db069215f678" containerName="payload-processing"
Jul 29 18:23:06.919034 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.918989    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de16f94e-dcaa-48f1-9d78-3e10105e08f8" containerName="payload-pre-processing"
Jul 29 18:23:06.923447 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.923426    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:06.926618 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.926596    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-697aa257-dockercfg-lx4j8\""
Jul 29 18:23:06.926954 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.926936    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-697aa257\""
Jul 29 18:23:06.937609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.937583    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:06.964863 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.964782    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:06.968400 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.968380    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:06.978870 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:06.978844    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:07.047302 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.047271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.047464 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.047331    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dcc6\" (UniqueName: \"kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.047464 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.047360    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcvxk\" (UniqueName: \"kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.047464 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.047414    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.148601 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.148557    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.148787 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.148655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.148787 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.148698    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dcc6\" (UniqueName: \"kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.148787 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.148715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcvxk\" (UniqueName: \"kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.149597 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.149574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.149642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.149574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.157555 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.157525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dcc6\" (UniqueName: \"kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6\") pod \"payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.157699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.157633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcvxk\" (UniqueName: \"kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk\") pod \"payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") " pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.234625 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.234526    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:07.281350 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.281310    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:07.443035 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.443008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:07.444956 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:23:07.444924    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f386da_0147_4bd5_a09f_34a753cc5281.slice/crio-ae902a385d08f3f5b16326ce4d7e5531fe35e454e6cdcb4464cda60613b14613 WatchSource:0}: Error finding container ae902a385d08f3f5b16326ce4d7e5531fe35e454e6cdcb4464cda60613b14613: Status 404 returned error can't find the container with id ae902a385d08f3f5b16326ce4d7e5531fe35e454e6cdcb4464cda60613b14613
Jul 29 18:23:07.599914 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:07.599887    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:07.601829 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:23:07.601801    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e48a833_9439_40b7_b60e_58fb385e50ab.slice/crio-66b3ca174a503f60ad4ae7eb48ce2b175b21901ea01b1d58599e2d787feb87f6 WatchSource:0}: Error finding container 66b3ca174a503f60ad4ae7eb48ce2b175b21901ea01b1d58599e2d787feb87f6: Status 404 returned error can't find the container with id 66b3ca174a503f60ad4ae7eb48ce2b175b21901ea01b1d58599e2d787feb87f6
Jul 29 18:23:08.327119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.327078    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" event={"ID":"75f386da-0147-4bd5-a09f-34a753cc5281","Type":"ContainerStarted","Data":"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"}
Jul 29 18:23:08.327599 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.327141    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:08.327599 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.327162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" event={"ID":"75f386da-0147-4bd5-a09f-34a753cc5281","Type":"ContainerStarted","Data":"ae902a385d08f3f5b16326ce4d7e5531fe35e454e6cdcb4464cda60613b14613"}
Jul 29 18:23:08.328734 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.328703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" event={"ID":"6e48a833-9439-40b7-b60e-58fb385e50ab","Type":"ContainerStarted","Data":"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"}
Jul 29 18:23:08.328799 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.328759    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" event={"ID":"6e48a833-9439-40b7-b60e-58fb385e50ab","Type":"ContainerStarted","Data":"66b3ca174a503f60ad4ae7eb48ce2b175b21901ea01b1d58599e2d787feb87f6"}
Jul 29 18:23:08.328799 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.328781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:08.344270 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.344173    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" podStartSLOduration=2.34415436 podStartE2EDuration="2.34415436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:23:08.342501705 +0000 UTC m=+1811.315543888" watchObservedRunningTime="2026-07-29 18:23:08.34415436 +0000 UTC m=+1811.317196540"
Jul 29 18:23:08.357737 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:08.357670    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" podStartSLOduration=2.357650655 podStartE2EDuration="2.357650655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:23:08.356982596 +0000 UTC m=+1811.330024790" watchObservedRunningTime="2026-07-29 18:23:08.357650655 +0000 UTC m=+1811.330692836"
Jul 29 18:23:19.335275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:19.335216    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.49:9004: connect: connection refused"
Jul 29 18:23:19.335813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:19.335729    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:29.335056 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:29.335019    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:30.849775 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.849729    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"]
Jul 29 18:23:30.855148 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.855116    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:30.858237 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.858208    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:23:30.858455 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.858261    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:23:30.858761 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.858737    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"]
Jul 29 18:23:30.871816 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.871785    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-697aa257-sfp5h\" (UID: \"5f54cded-1d40-4255-b3b4-efb789f094d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:30.972394 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.972352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-697aa257-sfp5h\" (UID: \"5f54cded-1d40-4255-b3b4-efb789f094d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:30.973052 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:30.973031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-697aa257-sfp5h\" (UID: \"5f54cded-1d40-4255-b3b4-efb789f094d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:31.169715 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:31.169618    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:31.309246 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:31.309218    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"]
Jul 29 18:23:31.311780 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:23:31.311748    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f54cded_1d40_4255_b3b4_efb789f094d0.slice/crio-2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9 WatchSource:0}: Error finding container 2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9: Status 404 returned error can't find the container with id 2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9
Jul 29 18:23:31.313738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:31.313722    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 18:23:31.449596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:31.449505    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h" event={"ID":"5f54cded-1d40-4255-b3b4-efb789f094d0","Type":"ContainerStarted","Data":"2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9"}
Jul 29 18:23:34.466951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:34.466854    2563 generic.go:356] "Generic (PLEG): container finished" podID="5f54cded-1d40-4255-b3b4-efb789f094d0" containerID="7865054dfa2321d1b981472e71711571678e0a6798b0ed5cfa900fb6d2b617dc" exitCode=0
Jul 29 18:23:34.466951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:34.466898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h" event={"ID":"5f54cded-1d40-4255-b3b4-efb789f094d0","Type":"ContainerDied","Data":"7865054dfa2321d1b981472e71711571678e0a6798b0ed5cfa900fb6d2b617dc"}
Jul 29 18:23:35.612441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:35.612416    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:35.714720 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:35.714665    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca\") pod \"5f54cded-1d40-4255-b3b4-efb789f094d0\" (UID: \"5f54cded-1d40-4255-b3b4-efb789f094d0\") "
Jul 29 18:23:35.715044 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:35.715019    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5f54cded-1d40-4255-b3b4-efb789f094d0" (UID: "5f54cded-1d40-4255-b3b4-efb789f094d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:23:35.815761 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:35.815673    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f54cded-1d40-4255-b3b4-efb789f094d0-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:36.478451 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:36.478416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h" event={"ID":"5f54cded-1d40-4255-b3b4-efb789f094d0","Type":"ContainerDied","Data":"2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9"}
Jul 29 18:23:36.478640 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:36.478465    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d51ac5af974db02e1fea4a3650eb6c5fbabb33d09350398b51facc76d4ba5b9"
Jul 29 18:23:36.478640 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:36.478426    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"
Jul 29 18:23:38.974491 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:38.974446    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:39.028575 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:39.028542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:46.774427 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.774385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:46.815150 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.815113    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:46.815443 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.815410    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" podUID="75f386da-0147-4bd5-a09f-34a753cc5281" containerName="payload-processing" containerID="cri-o://11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19" gracePeriod=30
Jul 29 18:23:46.823979 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.823946    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:46.824486 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.824331    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerName="payload-pre-processing" containerID="cri-o://f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74" gracePeriod=30
Jul 29 18:23:46.859940 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.859908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:46.926860 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.926822    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:46.976493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.976459    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"]
Jul 29 18:23:46.981314 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.981285    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-697aa257-sfp5h"]
Jul 29 18:23:46.993675 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:46.993594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:47.115568 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.115544    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:47.118555 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.118530    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:47.225484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.225445    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume\") pod \"6e48a833-9439-40b7-b60e-58fb385e50ab\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") "
Jul 29 18:23:47.225484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.225483    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume\") pod \"75f386da-0147-4bd5-a09f-34a753cc5281\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") "
Jul 29 18:23:47.225721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.225521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcvxk\" (UniqueName: \"kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk\") pod \"75f386da-0147-4bd5-a09f-34a753cc5281\" (UID: \"75f386da-0147-4bd5-a09f-34a753cc5281\") "
Jul 29 18:23:47.225721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.225556    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dcc6\" (UniqueName: \"kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6\") pod \"6e48a833-9439-40b7-b60e-58fb385e50ab\" (UID: \"6e48a833-9439-40b7-b60e-58fb385e50ab\") "
Jul 29 18:23:47.225965 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.225852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e48a833-9439-40b7-b60e-58fb385e50ab" (UID: "6e48a833-9439-40b7-b60e-58fb385e50ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:23:47.226082 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.226056    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75f386da-0147-4bd5-a09f-34a753cc5281" (UID: "75f386da-0147-4bd5-a09f-34a753cc5281"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:23:47.227745 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.227723    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6" (OuterVolumeSpecName: "kube-api-access-7dcc6") pod "6e48a833-9439-40b7-b60e-58fb385e50ab" (UID: "6e48a833-9439-40b7-b60e-58fb385e50ab"). InnerVolumeSpecName "kube-api-access-7dcc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:23:47.227832 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.227755    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk" (OuterVolumeSpecName: "kube-api-access-pcvxk") pod "75f386da-0147-4bd5-a09f-34a753cc5281" (UID: "75f386da-0147-4bd5-a09f-34a753cc5281"). InnerVolumeSpecName "kube-api-access-pcvxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:23:47.326529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.326429    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e48a833-9439-40b7-b60e-58fb385e50ab-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:47.326529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.326462    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75f386da-0147-4bd5-a09f-34a753cc5281-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:47.326529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.326472    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcvxk\" (UniqueName: \"kubernetes.io/projected/75f386da-0147-4bd5-a09f-34a753cc5281-kube-api-access-pcvxk\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:47.326529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.326480    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dcc6\" (UniqueName: \"kubernetes.io/projected/6e48a833-9439-40b7-b60e-58fb385e50ab-kube-api-access-7dcc6\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:23:47.530505 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.530465    2563 generic.go:356] "Generic (PLEG): container finished" podID="75f386da-0147-4bd5-a09f-34a753cc5281" containerID="11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19" exitCode=0
Jul 29 18:23:47.530505 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.530507    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"
Jul 29 18:23:47.530784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.530553    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" event={"ID":"75f386da-0147-4bd5-a09f-34a753cc5281","Type":"ContainerDied","Data":"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"}
Jul 29 18:23:47.530784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.530612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl" event={"ID":"75f386da-0147-4bd5-a09f-34a753cc5281","Type":"ContainerDied","Data":"ae902a385d08f3f5b16326ce4d7e5531fe35e454e6cdcb4464cda60613b14613"}
Jul 29 18:23:47.530784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.530641    2563 scope.go:117] "RemoveContainer" containerID="11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"
Jul 29 18:23:47.531932 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.531909    2563 generic.go:356] "Generic (PLEG): container finished" podID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerID="f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74" exitCode=0
Jul 29 18:23:47.532064 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.531957    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"
Jul 29 18:23:47.532064 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.531958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" event={"ID":"6e48a833-9439-40b7-b60e-58fb385e50ab","Type":"ContainerDied","Data":"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"}
Jul 29 18:23:47.532064 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.532011    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn" event={"ID":"6e48a833-9439-40b7-b60e-58fb385e50ab","Type":"ContainerDied","Data":"66b3ca174a503f60ad4ae7eb48ce2b175b21901ea01b1d58599e2d787feb87f6"}
Jul 29 18:23:47.540579 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.540559    2563 scope.go:117] "RemoveContainer" containerID="11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"
Jul 29 18:23:47.540921 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:23:47.540899    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19\": container with ID starting with 11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19 not found: ID does not exist" containerID="11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"
Jul 29 18:23:47.541029 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.540929    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19"} err="failed to get container status \"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19\": rpc error: code = NotFound desc = could not find container \"11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19\": container with ID starting with 11f755c055478c1e71ef44847c7c4e8ebb93c054c8076792bcd51e34defe5e19 not found: ID does not exist"
Jul 29 18:23:47.541029 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.540951    2563 scope.go:117] "RemoveContainer" containerID="f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"
Jul 29 18:23:47.549508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.549488    2563 scope.go:117] "RemoveContainer" containerID="f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"
Jul 29 18:23:47.549829 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:23:47.549810    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74\": container with ID starting with f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74 not found: ID does not exist" containerID="f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"
Jul 29 18:23:47.549873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.549838    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74"} err="failed to get container status \"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74\": rpc error: code = NotFound desc = could not find container \"f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74\": container with ID starting with f7a3af5541c281e96da3a66b0726f44e018db030eb438d03250dc8186a8a1c74 not found: ID does not exist"
Jul 29 18:23:47.556138 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.556113    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:47.560826 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.560800    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-697aa257-d7d7959b8-f4xtl"]
Jul 29 18:23:47.571977 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.571950    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:47.578413 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.578340    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-697aa257-b5f967bd-b9bwn"]
Jul 29 18:23:47.586180 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.586149    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f54cded-1d40-4255-b3b4-efb789f094d0" path="/var/lib/kubelet/pods/5f54cded-1d40-4255-b3b4-efb789f094d0/volumes"
Jul 29 18:23:47.586606 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.586588    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" path="/var/lib/kubelet/pods/6e48a833-9439-40b7-b60e-58fb385e50ab/volumes"
Jul 29 18:23:47.586983 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:47.586966    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75f386da-0147-4bd5-a09f-34a753cc5281" path="/var/lib/kubelet/pods/75f386da-0147-4bd5-a09f-34a753cc5281/volumes"
Jul 29 18:23:48.163754 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:48.163714    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:48.354459 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:48.354425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:48.559516 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:48.559421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:48.858966 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:48.858930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:49.144840 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:49.144753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:51.534875 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:51.534831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:51.634641 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:51.634609    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:52.746109 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:52.746077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:52.911158 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:52.911126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:53.400388 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.400356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:53.470281 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470244    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:23:53.470621 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470609    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f54cded-1d40-4255-b3b4-efb789f094d0" containerName="revoke-keys"
Jul 29 18:23:53.470666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470624    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f54cded-1d40-4255-b3b4-efb789f094d0" containerName="revoke-keys"
Jul 29 18:23:53.470666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerName="payload-pre-processing"
Jul 29 18:23:53.470666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470640    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerName="payload-pre-processing"
Jul 29 18:23:53.470666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470650    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f386da-0147-4bd5-a09f-34a753cc5281" containerName="payload-processing"
Jul 29 18:23:53.470666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470657    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f386da-0147-4bd5-a09f-34a753cc5281" containerName="payload-processing"
Jul 29 18:23:53.470822 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470726    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f386da-0147-4bd5-a09f-34a753cc5281" containerName="payload-processing"
Jul 29 18:23:53.470822 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470735    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e48a833-9439-40b7-b60e-58fb385e50ab" containerName="payload-pre-processing"
Jul 29 18:23:53.470822 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.470744    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f54cded-1d40-4255-b3b4-efb789f094d0" containerName="revoke-keys"
Jul 29 18:23:53.475470 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.475448    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.478718 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.478697    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0eed4609-dockercfg-spz2n\""
Jul 29 18:23:53.478844 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.478735    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0eed4609\""
Jul 29 18:23:53.489037 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.489000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:23:53.536305 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.536269    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:23:53.539256 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.539181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:23:53.539852 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.539831    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.552105 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.552075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:23:53.594867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.594832    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgql\" (UniqueName: \"kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.595107 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.595038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.696178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.696080    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgql\" (UniqueName: \"kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.696178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.696121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.696178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.696142    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qsx7\" (UniqueName: \"kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.696178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.696161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.696961 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.696941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.707931 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.707851    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgql\" (UniqueName: \"kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql\") pod \"payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.786605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.786568    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:53.796977 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.796950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.797087 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.796983    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qsx7\" (UniqueName: \"kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.797930 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.797902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.806292 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.806262    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qsx7\" (UniqueName: \"kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7\") pod \"payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") " pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.849448 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.849413    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:53.943001 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:53.942974    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:23:53.944996 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:23:53.944960    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb84705c9_7b19_406c_90b9_25ad2172e05f.slice/crio-ffd438a3038c3506ad86c1f6229122e81ada107a722befe59fe8ab6d28cde111 WatchSource:0}: Error finding container ffd438a3038c3506ad86c1f6229122e81ada107a722befe59fe8ab6d28cde111: Status 404 returned error can't find the container with id ffd438a3038c3506ad86c1f6229122e81ada107a722befe59fe8ab6d28cde111
Jul 29 18:23:54.014121 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.014008    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:23:54.017473 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:23:54.017444    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa22d93_9137_4cf9_8a0b_61f0446e7d49.slice/crio-1f0145dc147193dca98c941febaf6b6160b1a7a90b6adda99cbe3353bdac00ce WatchSource:0}: Error finding container 1f0145dc147193dca98c941febaf6b6160b1a7a90b6adda99cbe3353bdac00ce: Status 404 returned error can't find the container with id 1f0145dc147193dca98c941febaf6b6160b1a7a90b6adda99cbe3353bdac00ce
Jul 29 18:23:54.574596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.574551    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" event={"ID":"7aa22d93-9137-4cf9-8a0b-61f0446e7d49","Type":"ContainerStarted","Data":"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"}
Jul 29 18:23:54.574813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.574615    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" event={"ID":"7aa22d93-9137-4cf9-8a0b-61f0446e7d49","Type":"ContainerStarted","Data":"1f0145dc147193dca98c941febaf6b6160b1a7a90b6adda99cbe3353bdac00ce"}
Jul 29 18:23:54.574813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.574678    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:23:54.576495 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.576462    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" event={"ID":"b84705c9-7b19-406c-90b9-25ad2172e05f","Type":"ContainerStarted","Data":"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"}
Jul 29 18:23:54.576644 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.576514    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" event={"ID":"b84705c9-7b19-406c-90b9-25ad2172e05f","Type":"ContainerStarted","Data":"ffd438a3038c3506ad86c1f6229122e81ada107a722befe59fe8ab6d28cde111"}
Jul 29 18:23:54.576644 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.576541    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:23:54.593207 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.593150    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" podStartSLOduration=1.593135017 podStartE2EDuration="1.593135017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:23:54.592731255 +0000 UTC m=+1857.565773435" watchObservedRunningTime="2026-07-29 18:23:54.593135017 +0000 UTC m=+1857.566177197"
Jul 29 18:23:54.607461 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:23:54.607251    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" podStartSLOduration=1.607229075 podStartE2EDuration="1.607229075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:23:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:23:54.607051996 +0000 UTC m=+1857.580094175" watchObservedRunningTime="2026-07-29 18:23:54.607229075 +0000 UTC m=+1857.580271258"
Jul 29 18:24:05.586141 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:05.586113    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:24:05.586618 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:05.586182    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:24:23.212809 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.212717    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.236544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.236507    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:24:23.236818 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.236778    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" podUID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" containerName="payload-processing" containerID="cri-o://48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016" gracePeriod=30
Jul 29 18:24:23.242622 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.242587    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:24:23.243114 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.243078    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" podUID="b84705c9-7b19-406c-90b9-25ad2172e05f" containerName="payload-pre-processing" containerID="cri-o://939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508" gracePeriod=30
Jul 29 18:24:23.279048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.279013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.344947 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.344916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.403705 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.403666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.531066 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.531029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.547090 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.547064    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:24:23.550113 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.550091    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:24:23.682297 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682263    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume\") pod \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") "
Jul 29 18:24:23.682475 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682327    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqgql\" (UniqueName: \"kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql\") pod \"b84705c9-7b19-406c-90b9-25ad2172e05f\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") "
Jul 29 18:24:23.682475 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682449    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume\") pod \"b84705c9-7b19-406c-90b9-25ad2172e05f\" (UID: \"b84705c9-7b19-406c-90b9-25ad2172e05f\") "
Jul 29 18:24:23.682555 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682521    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qsx7\" (UniqueName: \"kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7\") pod \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\" (UID: \"7aa22d93-9137-4cf9-8a0b-61f0446e7d49\") "
Jul 29 18:24:23.682744 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7aa22d93-9137-4cf9-8a0b-61f0446e7d49" (UID: "7aa22d93-9137-4cf9-8a0b-61f0446e7d49"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:24:23.682875 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682837    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b84705c9-7b19-406c-90b9-25ad2172e05f" (UID: "b84705c9-7b19-406c-90b9-25ad2172e05f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:24:23.683011 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682954    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b84705c9-7b19-406c-90b9-25ad2172e05f-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:24:23.683011 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.682976    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:24:23.684567 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.684541    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql" (OuterVolumeSpecName: "kube-api-access-qqgql") pod "b84705c9-7b19-406c-90b9-25ad2172e05f" (UID: "b84705c9-7b19-406c-90b9-25ad2172e05f"). InnerVolumeSpecName "kube-api-access-qqgql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:24:23.684651 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.684563    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7" (OuterVolumeSpecName: "kube-api-access-9qsx7") pod "7aa22d93-9137-4cf9-8a0b-61f0446e7d49" (UID: "7aa22d93-9137-4cf9-8a0b-61f0446e7d49"). InnerVolumeSpecName "kube-api-access-9qsx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:24:23.735982 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.735949    2563 generic.go:356] "Generic (PLEG): container finished" podID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" containerID="48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016" exitCode=0
Jul 29 18:24:23.736161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.736017    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"
Jul 29 18:24:23.736161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.736026    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" event={"ID":"7aa22d93-9137-4cf9-8a0b-61f0446e7d49","Type":"ContainerDied","Data":"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"}
Jul 29 18:24:23.736161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.736073    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6" event={"ID":"7aa22d93-9137-4cf9-8a0b-61f0446e7d49","Type":"ContainerDied","Data":"1f0145dc147193dca98c941febaf6b6160b1a7a90b6adda99cbe3353bdac00ce"}
Jul 29 18:24:23.736161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.736102    2563 scope.go:117] "RemoveContainer" containerID="48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"
Jul 29 18:24:23.737487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.737465    2563 generic.go:356] "Generic (PLEG): container finished" podID="b84705c9-7b19-406c-90b9-25ad2172e05f" containerID="939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508" exitCode=0
Jul 29 18:24:23.737599 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.737540    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"
Jul 29 18:24:23.737599 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.737545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" event={"ID":"b84705c9-7b19-406c-90b9-25ad2172e05f","Type":"ContainerDied","Data":"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"}
Jul 29 18:24:23.737696 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.737599    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2" event={"ID":"b84705c9-7b19-406c-90b9-25ad2172e05f","Type":"ContainerDied","Data":"ffd438a3038c3506ad86c1f6229122e81ada107a722befe59fe8ab6d28cde111"}
Jul 29 18:24:23.740244 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.740189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:23.745316 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.745284    2563 scope.go:117] "RemoveContainer" containerID="48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"
Jul 29 18:24:23.745614 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:24:23.745596    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016\": container with ID starting with 48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016 not found: ID does not exist" containerID="48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"
Jul 29 18:24:23.745708 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.745626    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016"} err="failed to get container status \"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016\": rpc error: code = NotFound desc = could not find container \"48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016\": container with ID starting with 48c535d4b05ef00a639ba25ae8b0313a4ae17678b07e1b2861e0edda3186e016 not found: ID does not exist"
Jul 29 18:24:23.745708 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.745652    2563 scope.go:117] "RemoveContainer" containerID="939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"
Jul 29 18:24:23.754349 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.754312    2563 scope.go:117] "RemoveContainer" containerID="939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"
Jul 29 18:24:23.754631 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:24:23.754613    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508\": container with ID starting with 939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508 not found: ID does not exist" containerID="939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"
Jul 29 18:24:23.754688 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.754640    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508"} err="failed to get container status \"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508\": rpc error: code = NotFound desc = could not find container \"939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508\": container with ID starting with 939a674822585f9e6f77ca7f3e3e8a0325e99ce1416774a21143210926eba508 not found: ID does not exist"
Jul 29 18:24:23.764233 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.764174    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:24:23.766082 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.766053    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0eed4609-7775bd9658-7pdr6"]
Jul 29 18:24:23.778552 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.778467    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:24:23.785145 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.785118    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qsx7\" (UniqueName: \"kubernetes.io/projected/7aa22d93-9137-4cf9-8a0b-61f0446e7d49-kube-api-access-9qsx7\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:24:23.785145 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.785145    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqgql\" (UniqueName: \"kubernetes.io/projected/b84705c9-7b19-406c-90b9-25ad2172e05f-kube-api-access-qqgql\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:24:23.787176 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:23.787157    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0eed4609-bfdd8b7bd-dz6z2"]
Jul 29 18:24:24.201734 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:24.201692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:24.300809 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:24.300763    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:24.404692 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:24.404655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:25.587002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:25.586970    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" path="/var/lib/kubelet/pods/7aa22d93-9137-4cf9-8a0b-61f0446e7d49/volumes"
Jul 29 18:24:25.587385 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:25.587356    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b84705c9-7b19-406c-90b9-25ad2172e05f" path="/var/lib/kubelet/pods/b84705c9-7b19-406c-90b9-25ad2172e05f/volumes"
Jul 29 18:24:25.742339 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:25.742307    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:29.142146 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:29.142108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:31.584230 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:31.584158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:31.694104 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:31.694038    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:31.842486 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:31.842430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:31.963407 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:31.963371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:32.275244 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:32.275108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:24:58.247628 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:24:58.247583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:04.558727 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:04.558689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:04.664374 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:04.664324    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:04.762288 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:04.762231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:05.350248 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:05.350215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:20.638770 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:20.638738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:26.620616 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:26.620580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:26.724145 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:26.724112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:26.821989 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:26.821958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:37.301450 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:37.301417    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:38.086833 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:38.086787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:43.992997 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:43.992960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:44.096690 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:44.096663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:44.205441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:44.205402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:44.297136 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:44.297054    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:51.500592 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:51.500508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:51.663035 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:51.662999    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:51.775752 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:51.775663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:25:53.369174 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:25:53.369129    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:00.115639 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:00.115604    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:00.306901 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:00.306863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:00.752519 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:00.752468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:06.661265 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:06.661185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:06.762889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:06.762859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:06.935441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:06.935348    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:07.296863 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:07.296772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:07.469621 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:07.469592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:10.677472 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:10.677432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:10.772004 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:10.771973    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:11.920670 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:11.920639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:12.026738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.026708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:12.519399 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.519364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:12.615492 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.615458    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:12.676384 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676347    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:12.676760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676747    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b84705c9-7b19-406c-90b9-25ad2172e05f" containerName="payload-pre-processing"
Jul 29 18:26:12.676806 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676761    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b84705c9-7b19-406c-90b9-25ad2172e05f" containerName="payload-pre-processing"
Jul 29 18:26:12.676806 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676786    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" containerName="payload-processing"
Jul 29 18:26:12.676806 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676792    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" containerName="payload-processing"
Jul 29 18:26:12.676899 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676847    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aa22d93-9137-4cf9-8a0b-61f0446e7d49" containerName="payload-processing"
Jul 29 18:26:12.676899 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.676856    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b84705c9-7b19-406c-90b9-25ad2172e05f" containerName="payload-pre-processing"
Jul 29 18:26:12.679961 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.679942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.688814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.688784    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0cdae181-dockercfg-p89bg\""
Jul 29 18:26:12.690315 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.690298    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0cdae181\""
Jul 29 18:26:12.707379 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.707349    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:12.735945 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.735908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trkjm\" (UniqueName: \"kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.736112 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.735954    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.748984 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.748947    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:12.752505 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.752481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.764645 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.764617    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:12.837059 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.836963    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng68p\" (UniqueName: \"kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.837059 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.837006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.837340 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.837126    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trkjm\" (UniqueName: \"kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.837340 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.837159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.837924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.837903    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.849399 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.849369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trkjm\" (UniqueName: \"kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm\") pod \"payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") " pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:12.938512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.938468    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng68p\" (UniqueName: \"kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.938512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.938514    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.939236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.939180    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.956554 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.956519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng68p\" (UniqueName: \"kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p\") pod \"payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:12.990369 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:12.990334    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:13.064921 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.064875    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:13.154605 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:26:13.154574    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8bf2f5_b6a2_4654_9d07_bcef1222c70a.slice/crio-213f236db999956acc17c7bd33b7aa626b071e59325ed7af874bd6f063ba4c9f WatchSource:0}: Error finding container 213f236db999956acc17c7bd33b7aa626b071e59325ed7af874bd6f063ba4c9f: Status 404 returned error can't find the container with id 213f236db999956acc17c7bd33b7aa626b071e59325ed7af874bd6f063ba4c9f
Jul 29 18:26:13.154898 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.154877    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:13.232416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.232392    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:13.233917 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:26:13.233886    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f4803f3_0358_4c53_8d46_bc848753c90a.slice/crio-a1ad1794076fa1ece2651a8f98166833b5e1beca9c8512a2cec7673f7e0a5aa4 WatchSource:0}: Error finding container a1ad1794076fa1ece2651a8f98166833b5e1beca9c8512a2cec7673f7e0a5aa4: Status 404 returned error can't find the container with id a1ad1794076fa1ece2651a8f98166833b5e1beca9c8512a2cec7673f7e0a5aa4
Jul 29 18:26:13.269406 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.269373    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" event={"ID":"8f4803f3-0358-4c53-8d46-bc848753c90a","Type":"ContainerStarted","Data":"a1ad1794076fa1ece2651a8f98166833b5e1beca9c8512a2cec7673f7e0a5aa4"}
Jul 29 18:26:13.271359 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.271323    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" event={"ID":"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a","Type":"ContainerStarted","Data":"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"}
Jul 29 18:26:13.271518 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.271388    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" event={"ID":"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a","Type":"ContainerStarted","Data":"213f236db999956acc17c7bd33b7aa626b071e59325ed7af874bd6f063ba4c9f"}
Jul 29 18:26:13.271518 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.271464    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:13.293596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:13.293542    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" podStartSLOduration=1.293493989 podStartE2EDuration="1.293493989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:26:13.292159948 +0000 UTC m=+1996.265202145" watchObservedRunningTime="2026-07-29 18:26:13.293493989 +0000 UTC m=+1996.266536173"
Jul 29 18:26:14.279053 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:14.279013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" event={"ID":"8f4803f3-0358-4c53-8d46-bc848753c90a","Type":"ContainerStarted","Data":"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"}
Jul 29 18:26:14.279587 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:14.279107    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:14.294585 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:14.294532    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" podStartSLOduration=2.294514343 podStartE2EDuration="2.294514343s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:26:14.293277085 +0000 UTC m=+1997.266319277" watchObservedRunningTime="2026-07-29 18:26:14.294514343 +0000 UTC m=+1997.267556523"
Jul 29 18:26:24.281338 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:24.281304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:25.286534 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:25.286487    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.55:9004: connect: connection refused"
Jul 29 18:26:35.285694 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:35.285659    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:35.586878 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:35.586794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:36.853865 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:36.853829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:42.404926 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.404893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:42.507133 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.507103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:42.760737 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.760649    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"]
Jul 29 18:26:42.764182 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.764164    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:42.767104 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.767075    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:26:42.767104 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.767094    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:26:42.771506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.771483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"]
Jul 29 18:26:42.803351 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.803317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cdae181-scmcg\" (UID: \"1101d3ae-b802-4f54-b4cf-b25e6026f13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:42.904159 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.904117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cdae181-scmcg\" (UID: \"1101d3ae-b802-4f54-b4cf-b25e6026f13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:42.904781 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:42.904759    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-0cdae181-scmcg\" (UID: \"1101d3ae-b802-4f54-b4cf-b25e6026f13c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:43.076251 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:43.076136    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:43.215110 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:43.215075    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"]
Jul 29 18:26:43.217692 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:26:43.217664    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1101d3ae_b802_4f54_b4cf_b25e6026f13c.slice/crio-c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d WatchSource:0}: Error finding container c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d: Status 404 returned error can't find the container with id c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d
Jul 29 18:26:43.450656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:43.450620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg" event={"ID":"1101d3ae-b802-4f54-b4cf-b25e6026f13c","Type":"ContainerStarted","Data":"c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d"}
Jul 29 18:26:44.457603 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:44.457565    2563 generic.go:356] "Generic (PLEG): container finished" podID="1101d3ae-b802-4f54-b4cf-b25e6026f13c" containerID="aa2dabdb344e7e2aea06e55d02fc38cab7fbc4e2a3637a996af13d5f3f8944dd" exitCode=0
Jul 29 18:26:44.458002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:44.457634    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg" event={"ID":"1101d3ae-b802-4f54-b4cf-b25e6026f13c","Type":"ContainerDied","Data":"aa2dabdb344e7e2aea06e55d02fc38cab7fbc4e2a3637a996af13d5f3f8944dd"}
Jul 29 18:26:45.611449 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:45.611421    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:45.625417 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:45.625337    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca\") pod \"1101d3ae-b802-4f54-b4cf-b25e6026f13c\" (UID: \"1101d3ae-b802-4f54-b4cf-b25e6026f13c\") "
Jul 29 18:26:45.626136 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:45.626068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1101d3ae-b802-4f54-b4cf-b25e6026f13c" (UID: "1101d3ae-b802-4f54-b4cf-b25e6026f13c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:26:45.726467 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:45.726369    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1101d3ae-b802-4f54-b4cf-b25e6026f13c-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:26:46.468501 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:46.468466    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"
Jul 29 18:26:46.468685 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:46.468506    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg" event={"ID":"1101d3ae-b802-4f54-b4cf-b25e6026f13c","Type":"ContainerDied","Data":"c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d"}
Jul 29 18:26:46.468685 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:46.468554    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c72a91ad115912b12545f533283ecf551129bda0e31169730bcf91ce2d7a130d"
Jul 29 18:26:53.540817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.540778    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:53.568556 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.568513    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:53.568891 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.568822    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" podUID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" containerName="payload-processing" containerID="cri-o://b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d" gracePeriod=30
Jul 29 18:26:53.578307 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.577541    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:53.578307 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.577790    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerName="payload-pre-processing" containerID="cri-o://a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93" gracePeriod=30
Jul 29 18:26:53.620165 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.620133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:53.694022 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.693988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:53.757116 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.757086    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"]
Jul 29 18:26:53.763044 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.762916    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-0cdae181-scmcg"]
Jul 29 18:26:53.778499 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.778470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:53.872402 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.872370    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:53.875306 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.875280    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:53.905906 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.905872    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume\") pod \"8f4803f3-0358-4c53-8d46-bc848753c90a\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") "
Jul 29 18:26:53.905906 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.905910    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume\") pod \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") "
Jul 29 18:26:53.906159 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.905954    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trkjm\" (UniqueName: \"kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm\") pod \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\" (UID: \"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a\") "
Jul 29 18:26:53.906159 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.906067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng68p\" (UniqueName: \"kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p\") pod \"8f4803f3-0358-4c53-8d46-bc848753c90a\" (UID: \"8f4803f3-0358-4c53-8d46-bc848753c90a\") "
Jul 29 18:26:53.906361 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.906338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" (UID: "dd8bf2f5-b6a2-4654-9d07-bcef1222c70a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:26:53.906423 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.906356    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8f4803f3-0358-4c53-8d46-bc848753c90a" (UID: "8f4803f3-0358-4c53-8d46-bc848753c90a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:26:53.906511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.906494    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:26:53.906564 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.906519    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8f4803f3-0358-4c53-8d46-bc848753c90a-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:26:53.908237 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.908185    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p" (OuterVolumeSpecName: "kube-api-access-ng68p") pod "8f4803f3-0358-4c53-8d46-bc848753c90a" (UID: "8f4803f3-0358-4c53-8d46-bc848753c90a"). InnerVolumeSpecName "kube-api-access-ng68p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:26:53.908365 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:53.908345    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm" (OuterVolumeSpecName: "kube-api-access-trkjm") pod "dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" (UID: "dd8bf2f5-b6a2-4654-9d07-bcef1222c70a"). InnerVolumeSpecName "kube-api-access-trkjm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:26:54.006994 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.006952    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trkjm\" (UniqueName: \"kubernetes.io/projected/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a-kube-api-access-trkjm\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:26:54.006994 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.006988    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng68p\" (UniqueName: \"kubernetes.io/projected/8f4803f3-0358-4c53-8d46-bc848753c90a-kube-api-access-ng68p\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:26:54.126745 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.126710    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:54.510783 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.510685    2563 generic.go:356] "Generic (PLEG): container finished" podID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerID="a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93" exitCode=0
Jul 29 18:26:54.510783 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.510734    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"
Jul 29 18:26:54.510783 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.510774    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" event={"ID":"8f4803f3-0358-4c53-8d46-bc848753c90a","Type":"ContainerDied","Data":"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"}
Jul 29 18:26:54.511043 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.510836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5" event={"ID":"8f4803f3-0358-4c53-8d46-bc848753c90a","Type":"ContainerDied","Data":"a1ad1794076fa1ece2651a8f98166833b5e1beca9c8512a2cec7673f7e0a5aa4"}
Jul 29 18:26:54.511043 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.510868    2563 scope.go:117] "RemoveContainer" containerID="a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"
Jul 29 18:26:54.512209 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.512177    2563 generic.go:356] "Generic (PLEG): container finished" podID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" containerID="b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d" exitCode=0
Jul 29 18:26:54.512321 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.512236    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"
Jul 29 18:26:54.512321 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.512251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" event={"ID":"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a","Type":"ContainerDied","Data":"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"}
Jul 29 18:26:54.512321 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.512291    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9" event={"ID":"dd8bf2f5-b6a2-4654-9d07-bcef1222c70a","Type":"ContainerDied","Data":"213f236db999956acc17c7bd33b7aa626b071e59325ed7af874bd6f063ba4c9f"}
Jul 29 18:26:54.520423 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.520401    2563 scope.go:117] "RemoveContainer" containerID="a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"
Jul 29 18:26:54.520732 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:26:54.520709    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93\": container with ID starting with a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93 not found: ID does not exist" containerID="a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"
Jul 29 18:26:54.520813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.520740    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93"} err="failed to get container status \"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93\": rpc error: code = NotFound desc = could not find container \"a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93\": container with ID starting with a6f187f69c5f1dae749f6cc8e10f7ca5800015187d2df6ec2ae8bc766a926e93 not found: ID does not exist"
Jul 29 18:26:54.520813 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.520757    2563 scope.go:117] "RemoveContainer" containerID="b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"
Jul 29 18:26:54.529437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.529421    2563 scope.go:117] "RemoveContainer" containerID="b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"
Jul 29 18:26:54.529719 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:26:54.529698    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d\": container with ID starting with b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d not found: ID does not exist" containerID="b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"
Jul 29 18:26:54.529760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.529729    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d"} err="failed to get container status \"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d\": rpc error: code = NotFound desc = could not find container \"b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d\": container with ID starting with b57340bc416b451ea740a7bb036dd6f7467745d895032eb964efc9d1271a836d not found: ID does not exist"
Jul 29 18:26:54.536544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.536515    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:54.541544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.541517    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0cdae181-7b6d877b66-rkxw9"]
Jul 29 18:26:54.551941 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.551906    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:54.555819 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:54.555793    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0cdae181-86b57c9fdd-vrbx5"]
Jul 29 18:26:55.586730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:55.586694    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1101d3ae-b802-4f54-b4cf-b25e6026f13c" path="/var/lib/kubelet/pods/1101d3ae-b802-4f54-b4cf-b25e6026f13c/volumes"
Jul 29 18:26:55.587181 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:55.587046    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" path="/var/lib/kubelet/pods/8f4803f3-0358-4c53-8d46-bc848753c90a/volumes"
Jul 29 18:26:55.587374 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:55.587361    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" path="/var/lib/kubelet/pods/dd8bf2f5-b6a2-4654-9d07-bcef1222c70a/volumes"
Jul 29 18:26:59.860095 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:59.860060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:26:59.920993 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:26:59.920954    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:00.124657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:00.124578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:00.347122 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:00.347072    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:00.465680 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:00.465594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:00.565364 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:00.565327    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:00.722961 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:00.722885    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:06.508485 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:06.508457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:06.618333 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:06.618294    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:06.710576 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:06.710542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:06.857057 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:06.857026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:12.717704 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:12.717666    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:12.776672 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:12.776640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:19.514143 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:19.514064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:19.824058 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:19.823931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:19.942080 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:19.942025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:23.073440 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:23.073406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:23.173803 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:23.173713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:24.171352 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.171311    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:24.507487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.507380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:24.769362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.769275    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:24.874924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.874891    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:24.881607 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881580    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:27:24.881955 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881944    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1101d3ae-b802-4f54-b4cf-b25e6026f13c" containerName="revoke-keys"
Jul 29 18:27:24.882002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881957    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1101d3ae-b802-4f54-b4cf-b25e6026f13c" containerName="revoke-keys"
Jul 29 18:27:24.882002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881971    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerName="payload-pre-processing"
Jul 29 18:27:24.882002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881977    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerName="payload-pre-processing"
Jul 29 18:27:24.882002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881987    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" containerName="payload-processing"
Jul 29 18:27:24.882002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.881992    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" containerName="payload-processing"
Jul 29 18:27:24.882152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.882043    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd8bf2f5-b6a2-4654-9d07-bcef1222c70a" containerName="payload-processing"
Jul 29 18:27:24.882152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.882051    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f4803f3-0358-4c53-8d46-bc848753c90a" containerName="payload-pre-processing"
Jul 29 18:27:24.882152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.882061    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1101d3ae-b802-4f54-b4cf-b25e6026f13c" containerName="revoke-keys"
Jul 29 18:27:24.885086 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.885068    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:24.888026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.888007    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9245df36\""
Jul 29 18:27:24.896841 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.896816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:27:24.992246 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.992183    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9t82\" (UniqueName: \"kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:24.992438 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:24.992347    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.025790 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.025708    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:27:25.029138 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.029122    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.031740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.031713    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9245df36-dockercfg-6slbp\""
Jul 29 18:27:25.039656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.039628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:27:25.093073 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.093035    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9t82\" (UniqueName: \"kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.093286 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.093104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.093781 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.093762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.103203 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.103169    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9t82\" (UniqueName: \"kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82\") pod \"payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.194171 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.194131    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.194604 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.194184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kd2z\" (UniqueName: \"kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.195975 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.195956    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.295074 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.295039    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.295232 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.295128    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kd2z\" (UniqueName: \"kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.295843 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.295818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.303469 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.303416    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kd2z\" (UniqueName: \"kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z\") pod \"payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") " pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.341041 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.341004    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.510178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.510154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:27:25.511966 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:27:25.511939    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4fd473_39d3_448b_acaa_32d7edb2823a.slice/crio-98664712a3c84c6e6dd1eb21bb81efc19871123755919912f10586a84b78817e WatchSource:0}: Error finding container 98664712a3c84c6e6dd1eb21bb81efc19871123755919912f10586a84b78817e: Status 404 returned error can't find the container with id 98664712a3c84c6e6dd1eb21bb81efc19871123755919912f10586a84b78817e
Jul 29 18:27:25.549092 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.549062    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:27:25.550130 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:27:25.550098    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94dda78c_874b_4177_8136_5357d6663235.slice/crio-2f403b5775c94f87f07d0e2dec80176f59f646b77c5b1d665509127d671d3e14 WatchSource:0}: Error finding container 2f403b5775c94f87f07d0e2dec80176f59f646b77c5b1d665509127d671d3e14: Status 404 returned error can't find the container with id 2f403b5775c94f87f07d0e2dec80176f59f646b77c5b1d665509127d671d3e14
Jul 29 18:27:25.677073 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.676952    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" event={"ID":"94dda78c-874b-4177-8136-5357d6663235","Type":"ContainerStarted","Data":"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"}
Jul 29 18:27:25.677073 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.677013    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" event={"ID":"94dda78c-874b-4177-8136-5357d6663235","Type":"ContainerStarted","Data":"2f403b5775c94f87f07d0e2dec80176f59f646b77c5b1d665509127d671d3e14"}
Jul 29 18:27:25.677342 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.677127    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:25.678852 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.678760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" event={"ID":"cd4fd473-39d3-448b-acaa-32d7edb2823a","Type":"ContainerStarted","Data":"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"}
Jul 29 18:27:25.678852 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.678811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:25.678852 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.678828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" event={"ID":"cd4fd473-39d3-448b-acaa-32d7edb2823a","Type":"ContainerStarted","Data":"98664712a3c84c6e6dd1eb21bb81efc19871123755919912f10586a84b78817e"}
Jul 29 18:27:25.695587 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.695520    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" podStartSLOduration=1.695499426 podStartE2EDuration="1.695499426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:27:25.693408686 +0000 UTC m=+2068.666450866" watchObservedRunningTime="2026-07-29 18:27:25.695499426 +0000 UTC m=+2068.668541607"
Jul 29 18:27:25.712070 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:25.712017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" podStartSLOduration=0.712000832 podStartE2EDuration="712.000832ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:27:25.711289684 +0000 UTC m=+2068.684331863" watchObservedRunningTime="2026-07-29 18:27:25.712000832 +0000 UTC m=+2068.685043012"
Jul 29 18:27:36.685639 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:36.685608    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:27:36.686160 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:36.685689    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:27:48.031983 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:48.031946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:27:57.854290 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:57.854258    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:27:57.857106 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:57.857083    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:27:57.860003 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:57.859978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:27:57.862774 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:57.862753    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:27:57.907515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:27:57.907480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:27.406761 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.406718    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"]
Jul 29 18:28:27.410623 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.410598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:27.413365 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.413337    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:28:27.413529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.413396    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:28:27.417003 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.416979    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"]
Jul 29 18:28:27.471266 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.471228    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9245df36-hh8kp\" (UID: \"0fbb4965-cf1d-42d0-831c-d716187802d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:27.572517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.572481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9245df36-hh8kp\" (UID: \"0fbb4965-cf1d-42d0-831c-d716187802d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:27.573166 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.573143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9245df36-hh8kp\" (UID: \"0fbb4965-cf1d-42d0-831c-d716187802d4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:27.723973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.723888    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:27.873789 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.873608    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"]
Jul 29 18:28:27.876387 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:28:27.876356    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fbb4965_cf1d_42d0_831c_d716187802d4.slice/crio-d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0 WatchSource:0}: Error finding container d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0: Status 404 returned error can't find the container with id d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0
Jul 29 18:28:27.986023 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:27.985935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp" event={"ID":"0fbb4965-cf1d-42d0-831c-d716187802d4","Type":"ContainerStarted","Data":"d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0"}
Jul 29 18:28:28.991740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:28.991703    2563 generic.go:356] "Generic (PLEG): container finished" podID="0fbb4965-cf1d-42d0-831c-d716187802d4" containerID="db2757c882e81aae888a655645ed91dfb73787b8317a7f05aa7bdacc141554ef" exitCode=0
Jul 29 18:28:28.992174 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:28.991789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp" event={"ID":"0fbb4965-cf1d-42d0-831c-d716187802d4","Type":"ContainerDied","Data":"db2757c882e81aae888a655645ed91dfb73787b8317a7f05aa7bdacc141554ef"}
Jul 29 18:28:30.133750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:30.133721    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:30.196751 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:30.196716    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca\") pod \"0fbb4965-cf1d-42d0-831c-d716187802d4\" (UID: \"0fbb4965-cf1d-42d0-831c-d716187802d4\") "
Jul 29 18:28:30.197123 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:30.197097    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fbb4965-cf1d-42d0-831c-d716187802d4" (UID: "0fbb4965-cf1d-42d0-831c-d716187802d4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:28:30.297961 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:30.297868    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fbb4965-cf1d-42d0-831c-d716187802d4-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:28:31.003910 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:31.003879    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"
Jul 29 18:28:31.003910 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:31.003898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp" event={"ID":"0fbb4965-cf1d-42d0-831c-d716187802d4","Type":"ContainerDied","Data":"d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0"}
Jul 29 18:28:31.004135 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:31.003967    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d111e30e647809366c6188c33f71643861ab7b34ebe4a7f8a7cb078318da5dc0"
Jul 29 18:28:43.062899 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.062858    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:43.089390 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.089345    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:28:43.089741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.089708    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" podUID="cd4fd473-39d3-448b-acaa-32d7edb2823a" containerName="payload-processing" containerID="cri-o://86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d" gracePeriod=30
Jul 29 18:28:43.100966 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.100411    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:28:43.100966 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.100655    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" podUID="94dda78c-874b-4177-8136-5357d6663235" containerName="payload-pre-processing" containerID="cri-o://4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac" gracePeriod=30
Jul 29 18:28:43.134122 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.134086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:43.204920 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.204886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:43.233650 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.233612    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"]
Jul 29 18:28:43.236629 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.236599    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9245df36-hh8kp"]
Jul 29 18:28:43.312791 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.312693    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:43.399684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.399657    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:28:43.402523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.402501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:28:43.527763 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.527725    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume\") pod \"cd4fd473-39d3-448b-acaa-32d7edb2823a\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") "
Jul 29 18:28:43.527763 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.527778    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume\") pod \"94dda78c-874b-4177-8136-5357d6663235\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") "
Jul 29 18:28:43.527999 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.527967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kd2z\" (UniqueName: \"kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z\") pod \"cd4fd473-39d3-448b-acaa-32d7edb2823a\" (UID: \"cd4fd473-39d3-448b-acaa-32d7edb2823a\") "
Jul 29 18:28:43.528061 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.528017    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m9t82\" (UniqueName: \"kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82\") pod \"94dda78c-874b-4177-8136-5357d6663235\" (UID: \"94dda78c-874b-4177-8136-5357d6663235\") "
Jul 29 18:28:43.528132 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.528101    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd4fd473-39d3-448b-acaa-32d7edb2823a" (UID: "cd4fd473-39d3-448b-acaa-32d7edb2823a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:28:43.528221 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.528166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "94dda78c-874b-4177-8136-5357d6663235" (UID: "94dda78c-874b-4177-8136-5357d6663235"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:28:43.528373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.528357    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd4fd473-39d3-448b-acaa-32d7edb2823a-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:28:43.528442 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.528373    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/94dda78c-874b-4177-8136-5357d6663235-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:28:43.530153 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.530114    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82" (OuterVolumeSpecName: "kube-api-access-m9t82") pod "94dda78c-874b-4177-8136-5357d6663235" (UID: "94dda78c-874b-4177-8136-5357d6663235"). InnerVolumeSpecName "kube-api-access-m9t82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:28:43.530280 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.530178    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z" (OuterVolumeSpecName: "kube-api-access-2kd2z") pod "cd4fd473-39d3-448b-acaa-32d7edb2823a" (UID: "cd4fd473-39d3-448b-acaa-32d7edb2823a"). InnerVolumeSpecName "kube-api-access-2kd2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:28:43.586383 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.586299    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fbb4965-cf1d-42d0-831c-d716187802d4" path="/var/lib/kubelet/pods/0fbb4965-cf1d-42d0-831c-d716187802d4/volumes"
Jul 29 18:28:43.629872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.629829    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m9t82\" (UniqueName: \"kubernetes.io/projected/94dda78c-874b-4177-8136-5357d6663235-kube-api-access-m9t82\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:28:43.629872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:43.629862    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kd2z\" (UniqueName: \"kubernetes.io/projected/cd4fd473-39d3-448b-acaa-32d7edb2823a-kube-api-access-2kd2z\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:28:44.073532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.073497    2563 generic.go:356] "Generic (PLEG): container finished" podID="94dda78c-874b-4177-8136-5357d6663235" containerID="4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac" exitCode=0
Jul 29 18:28:44.073981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.073546    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"
Jul 29 18:28:44.073981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.073574    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" event={"ID":"94dda78c-874b-4177-8136-5357d6663235","Type":"ContainerDied","Data":"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"}
Jul 29 18:28:44.073981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.073626    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7" event={"ID":"94dda78c-874b-4177-8136-5357d6663235","Type":"ContainerDied","Data":"2f403b5775c94f87f07d0e2dec80176f59f646b77c5b1d665509127d671d3e14"}
Jul 29 18:28:44.073981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.073655    2563 scope.go:117] "RemoveContainer" containerID="4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"
Jul 29 18:28:44.075067 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.075043    2563 generic.go:356] "Generic (PLEG): container finished" podID="cd4fd473-39d3-448b-acaa-32d7edb2823a" containerID="86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d" exitCode=0
Jul 29 18:28:44.075161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.075098    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"
Jul 29 18:28:44.075161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.075126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" event={"ID":"cd4fd473-39d3-448b-acaa-32d7edb2823a","Type":"ContainerDied","Data":"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"}
Jul 29 18:28:44.075330 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.075176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r" event={"ID":"cd4fd473-39d3-448b-acaa-32d7edb2823a","Type":"ContainerDied","Data":"98664712a3c84c6e6dd1eb21bb81efc19871123755919912f10586a84b78817e"}
Jul 29 18:28:44.085168 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.085151    2563 scope.go:117] "RemoveContainer" containerID="4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"
Jul 29 18:28:44.085478 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:28:44.085460    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac\": container with ID starting with 4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac not found: ID does not exist" containerID="4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"
Jul 29 18:28:44.085541 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.085492    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac"} err="failed to get container status \"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac\": rpc error: code = NotFound desc = could not find container \"4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac\": container with ID starting with 4262271ef4c991dea8f6f5bb91235d180022fb57bf58c6e75c89cea89796b4ac not found: ID does not exist"
Jul 29 18:28:44.085541 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.085511    2563 scope.go:117] "RemoveContainer" containerID="86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"
Jul 29 18:28:44.094867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.094473    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:28:44.094867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.094658    2563 scope.go:117] "RemoveContainer" containerID="86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"
Jul 29 18:28:44.095031 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:28:44.095000    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d\": container with ID starting with 86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d not found: ID does not exist" containerID="86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"
Jul 29 18:28:44.095092 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.095042    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d"} err="failed to get container status \"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d\": rpc error: code = NotFound desc = could not find container \"86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d\": container with ID starting with 86a226c16dc4908b992a4701e537a55fe977869b421e38b77f19c66b62d9993d not found: ID does not exist"
Jul 29 18:28:44.100083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.100053    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9245df36-5c7865498d-vtgj7"]
Jul 29 18:28:44.112360 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.112326    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:28:44.118031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:44.117999    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9245df36-66f5df47b6-2qd7r"]
Jul 29 18:28:45.586544 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:45.586511    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94dda78c-874b-4177-8136-5357d6663235" path="/var/lib/kubelet/pods/94dda78c-874b-4177-8136-5357d6663235/volumes"
Jul 29 18:28:45.586942 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:45.586851    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4fd473-39d3-448b-acaa-32d7edb2823a" path="/var/lib/kubelet/pods/cd4fd473-39d3-448b-acaa-32d7edb2823a/volumes"
Jul 29 18:28:46.330214 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:46.330171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:51.411122 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:51.411042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:53.138886 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:53.138846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:28:53.195424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:28:53.195374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:21.923397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:21.923356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:22.487119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:22.487083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:27.946548 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:27.946512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:28.047565 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:28.047530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:28.195975 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:28.195937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:28.426257 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:28.426224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:29.520665 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:29.520633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:29.615264 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:29.615228    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:30.347339 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:30.347303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:30.438457 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:30.438424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:30.554482 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:30.554444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:31.865149 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:31.865118    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:37.677379 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:37.677345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:37.778448 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:37.778413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:38.343102 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:38.343070    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:44.177976 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:44.177937    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:44.282111 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:44.282077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:44.377833 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:44.377797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:54.871149 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:54.871115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:55.200889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:55.200799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:29:58.323047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:29:58.323013    2563 scope.go:117] "RemoveContainer" containerID="7865054dfa2321d1b981472e71711571678e0a6798b0ed5cfa900fb6d2b617dc"
Jul 29 18:30:16.454576 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:16.454527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:22.634928 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:22.634848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:22.734643 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:22.734616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:22.989571 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:22.989490    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:23.333610 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:23.333538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:24.074867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:24.074833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:25.999968 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:25.999926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:26.271230 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:26.271130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:27.196699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.196657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:27.641825 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.641785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:27.830254 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.830223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:27.921957 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.921875    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:27.961891 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.961861    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:30:27.962275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962257    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4fd473-39d3-448b-acaa-32d7edb2823a" containerName="payload-processing"
Jul 29 18:30:27.962358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962277    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4fd473-39d3-448b-acaa-32d7edb2823a" containerName="payload-processing"
Jul 29 18:30:27.962358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962297    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fbb4965-cf1d-42d0-831c-d716187802d4" containerName="revoke-keys"
Jul 29 18:30:27.962358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962303    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fbb4965-cf1d-42d0-831c-d716187802d4" containerName="revoke-keys"
Jul 29 18:30:27.962358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962310    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94dda78c-874b-4177-8136-5357d6663235" containerName="payload-pre-processing"
Jul 29 18:30:27.962358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962316    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="94dda78c-874b-4177-8136-5357d6663235" containerName="payload-pre-processing"
Jul 29 18:30:27.962609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962375    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fbb4965-cf1d-42d0-831c-d716187802d4" containerName="revoke-keys"
Jul 29 18:30:27.962609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962385    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="94dda78c-874b-4177-8136-5357d6663235" containerName="payload-pre-processing"
Jul 29 18:30:27.962609 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.962390    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4fd473-39d3-448b-acaa-32d7edb2823a" containerName="payload-processing"
Jul 29 18:30:27.965505 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.965483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:27.968592 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.968561    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-8cd341\""
Jul 29 18:30:27.968767 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.968664    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-8cd341-dockercfg-44rmf\""
Jul 29 18:30:27.974786 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.974757    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:30:27.978980 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.978952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:27.979119 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.978992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngrh2\" (UniqueName: \"kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:27.996018 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.995984    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:30:27.999496 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:27.999478    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.007279 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.007168    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:30:28.079529 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.079493    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.079742 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.079538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngrh2\" (UniqueName: \"kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.079742 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.079567    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncxf\" (UniqueName: \"kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.079742 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.079596    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.080362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.080340    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.090260 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.090189    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngrh2\" (UniqueName: \"kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2\") pod \"payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") " pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.180641 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.180542    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncxf\" (UniqueName: \"kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.180641 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.180584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.181415 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.181395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.189088 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.189063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncxf\" (UniqueName: \"kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf\") pod \"payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.277736 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.277691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.311946 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.311895    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.451053 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.451025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:30:28.453709 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:30:28.453669    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e2ba88_f0af_43d1_9151_9bd70bb86ce3.slice/crio-92df3bf4faf283343ce534807c363fbb7a56aef0c28b7b2a2026bd4c18a5b337 WatchSource:0}: Error finding container 92df3bf4faf283343ce534807c363fbb7a56aef0c28b7b2a2026bd4c18a5b337: Status 404 returned error can't find the container with id 92df3bf4faf283343ce534807c363fbb7a56aef0c28b7b2a2026bd4c18a5b337
Jul 29 18:30:28.500041 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.500011    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:30:28.505652 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:30:28.505613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf68b6fc_bdcb_4b0b_9068_3571339c5ad7.slice/crio-174feb46d43b37ad4cfe94997c7b8aa57517b6ad5fe51b5c32d03c81fa64ba14 WatchSource:0}: Error finding container 174feb46d43b37ad4cfe94997c7b8aa57517b6ad5fe51b5c32d03c81fa64ba14: Status 404 returned error can't find the container with id 174feb46d43b37ad4cfe94997c7b8aa57517b6ad5fe51b5c32d03c81fa64ba14
Jul 29 18:30:28.616803 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.616765    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" event={"ID":"af68b6fc-bdcb-4b0b-9068-3571339c5ad7","Type":"ContainerStarted","Data":"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"}
Jul 29 18:30:28.617031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.616829    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" event={"ID":"af68b6fc-bdcb-4b0b-9068-3571339c5ad7","Type":"ContainerStarted","Data":"174feb46d43b37ad4cfe94997c7b8aa57517b6ad5fe51b5c32d03c81fa64ba14"}
Jul 29 18:30:28.617031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.616861    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:28.618365 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.618329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" event={"ID":"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3","Type":"ContainerStarted","Data":"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"}
Jul 29 18:30:28.618487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.618382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:28.618487 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.618398    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" event={"ID":"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3","Type":"ContainerStarted","Data":"92df3bf4faf283343ce534807c363fbb7a56aef0c28b7b2a2026bd4c18a5b337"}
Jul 29 18:30:28.647647 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.647591    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" podStartSLOduration=1.6475768450000001 podStartE2EDuration="1.647576845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:30:28.646858364 +0000 UTC m=+2251.619900561" watchObservedRunningTime="2026-07-29 18:30:28.647576845 +0000 UTC m=+2251.620619025"
Jul 29 18:30:28.673378 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:28.673312    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" podStartSLOduration=1.673288822 podStartE2EDuration="1.673288822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:30:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:30:28.672337306 +0000 UTC m=+2251.645379499" watchObservedRunningTime="2026-07-29 18:30:28.673288822 +0000 UTC m=+2251.646331003"
Jul 29 18:30:39.625233 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:39.625182    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:30:39.625629 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:39.625281    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:30:51.000369 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:51.000333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:51.324972 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:51.324888    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:51.652401 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:51.652373    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:52.323716 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:52.323682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:54.337302 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:54.337264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:54.456686 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:54.456651    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:55.439265 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:55.439226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:55.950601 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:55.950551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:56.047439 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.047406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:30:56.054699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.054666    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:30:56.058415 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.058383    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.061243 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.061217    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-e6623d\""
Jul 29 18:30:56.070562 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.070530    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:30:56.072673 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.072645    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:30:56.076649 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.076625    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.079606 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.079579    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-e6623d-dockercfg-j9gbf\""
Jul 29 18:30:56.086774 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.086745    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:30:56.141741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.141698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.141939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.141753    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42gt\" (UniqueName: \"kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.242876 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.242769    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.242876 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.242830    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.243129 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.242941    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42gt\" (UniqueName: \"kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.243129 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.242995    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdgtb\" (UniqueName: \"kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.243635 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.243615    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.252141 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.252101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42gt\" (UniqueName: \"kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt\") pod \"payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.343802 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.343759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.343995 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.343932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdgtb\" (UniqueName: \"kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.344546 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.344530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.353449 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.353419    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdgtb\" (UniqueName: \"kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb\") pod \"payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") " pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.374182 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.374144    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.390076 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.390033    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.534398 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.534364    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:30:56.536445 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:30:56.536407    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc1035f_5cb4_4ecf_9306_34a5c27f73c2.slice/crio-4c0cc7c0c1a7106047fac8231beb87bfa50cc5e4bfa6c135bffcd564625514ae WatchSource:0}: Error finding container 4c0cc7c0c1a7106047fac8231beb87bfa50cc5e4bfa6c135bffcd564625514ae: Status 404 returned error can't find the container with id 4c0cc7c0c1a7106047fac8231beb87bfa50cc5e4bfa6c135bffcd564625514ae
Jul 29 18:30:56.566029 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.565996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:30:56.573438 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:30:56.573408    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3ac9ac8_6012_4107_a1e5_7b1eb1fded22.slice/crio-680f375ec1bae7cf2879229e4a2a41b7f593b0ee4b01368010f9e55264c181d8 WatchSource:0}: Error finding container 680f375ec1bae7cf2879229e4a2a41b7f593b0ee4b01368010f9e55264c181d8: Status 404 returned error can't find the container with id 680f375ec1bae7cf2879229e4a2a41b7f593b0ee4b01368010f9e55264c181d8
Jul 29 18:30:56.768626 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.768523    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" event={"ID":"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2","Type":"ContainerStarted","Data":"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"}
Jul 29 18:30:56.768626 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.768588    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" event={"ID":"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2","Type":"ContainerStarted","Data":"4c0cc7c0c1a7106047fac8231beb87bfa50cc5e4bfa6c135bffcd564625514ae"}
Jul 29 18:30:56.768626 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.768617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:30:56.770578 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.770546    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" event={"ID":"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22","Type":"ContainerStarted","Data":"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"}
Jul 29 18:30:56.770699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.770603    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" event={"ID":"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22","Type":"ContainerStarted","Data":"680f375ec1bae7cf2879229e4a2a41b7f593b0ee4b01368010f9e55264c181d8"}
Jul 29 18:30:56.770699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.770644    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:30:56.786904 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.786855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" podStartSLOduration=0.786838221 podStartE2EDuration="786.838221ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:30:56.785443782 +0000 UTC m=+2279.758485980" watchObservedRunningTime="2026-07-29 18:30:56.786838221 +0000 UTC m=+2279.759880402"
Jul 29 18:30:56.803983 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:30:56.803923    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" podStartSLOduration=0.803896766 podStartE2EDuration="803.896766ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:30:56.801873735 +0000 UTC m=+2279.774915915" watchObservedRunningTime="2026-07-29 18:30:56.803896766 +0000 UTC m=+2279.776938946"
Jul 29 18:31:07.780052 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:31:07.780017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:31:07.780694 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:31:07.780098    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:31:19.186785 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:31:19.186725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:31:28.162142 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:31:28.162101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:31:38.487722 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:31:38.487690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:09.992961 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:09.992862    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:10.093740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:10.093703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:11.852066 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:11.852033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:54.266872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:54.266834    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:55.351132 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.351081    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"]
Jul 29 18:32:55.354750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.354731    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:55.357539 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.357512    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:32:55.357723 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.357703    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:32:55.364380 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.364351    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"]
Jul 29 18:32:55.433988 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.433935    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88\" (UID: \"5138e65d-db26-4e70-bd3b-6eefb345a1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:55.534998 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.534957    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88\" (UID: \"5138e65d-db26-4e70-bd3b-6eefb345a1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:55.535711 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.535684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88\" (UID: \"5138e65d-db26-4e70-bd3b-6eefb345a1fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:55.667800 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.667707    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:55.669718 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:55.669690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:32:56.021455 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:56.021423    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"]
Jul 29 18:32:56.023590 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:32:56.023563    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5138e65d_db26_4e70_bd3b_6eefb345a1fe.slice/crio-777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5 WatchSource:0}: Error finding container 777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5: Status 404 returned error can't find the container with id 777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5
Jul 29 18:32:56.380467 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:56.380420    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88" event={"ID":"5138e65d-db26-4e70-bd3b-6eefb345a1fe","Type":"ContainerStarted","Data":"2ddded2247145abc26c1244f8d56094b8566e1a106163685a86144a50c7ed892"}
Jul 29 18:32:56.380850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:56.380515    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88" event={"ID":"5138e65d-db26-4e70-bd3b-6eefb345a1fe","Type":"ContainerStarted","Data":"777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5"}
Jul 29 18:32:56.396595 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:56.396546    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88" podStartSLOduration=1.396530995 podStartE2EDuration="1.396530995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:32:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:32:56.395705158 +0000 UTC m=+2399.368747339" watchObservedRunningTime="2026-07-29 18:32:56.396530995 +0000 UTC m=+2399.369573175"
Jul 29 18:32:57.387847 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.387813    2563 generic.go:356] "Generic (PLEG): container finished" podID="5138e65d-db26-4e70-bd3b-6eefb345a1fe" containerID="2ddded2247145abc26c1244f8d56094b8566e1a106163685a86144a50c7ed892" exitCode=0
Jul 29 18:32:57.388328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.387866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88" event={"ID":"5138e65d-db26-4e70-bd3b-6eefb345a1fe","Type":"ContainerDied","Data":"2ddded2247145abc26c1244f8d56094b8566e1a106163685a86144a50c7ed892"}
Jul 29 18:32:57.883935 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.883908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:32:57.886668 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.886640    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:32:57.891017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.890996    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:32:57.893822 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:57.893801    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:32:58.357922 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:58.357890    2563 scope.go:117] "RemoveContainer" containerID="aa2dabdb344e7e2aea06e55d02fc38cab7fbc4e2a3637a996af13d5f3f8944dd"
Jul 29 18:32:58.543595 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:58.543566    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:58.564605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:58.564574    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca\") pod \"5138e65d-db26-4e70-bd3b-6eefb345a1fe\" (UID: \"5138e65d-db26-4e70-bd3b-6eefb345a1fe\") "
Jul 29 18:32:58.565046 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:58.565018    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5138e65d-db26-4e70-bd3b-6eefb345a1fe" (UID: "5138e65d-db26-4e70-bd3b-6eefb345a1fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:32:58.665975 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:58.665883    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5138e65d-db26-4e70-bd3b-6eefb345a1fe-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:32:59.399448 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:59.399416    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"
Jul 29 18:32:59.399448 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:59.399435    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88" event={"ID":"5138e65d-db26-4e70-bd3b-6eefb345a1fe","Type":"ContainerDied","Data":"777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5"}
Jul 29 18:32:59.399714 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:32:59.399480    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="777db5d5a15d3f0e5e9f92f0f59e7af3a21e42775e88c0b80e3a1cce4a5656f5"
Jul 29 18:33:05.863108 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:05.863068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:05.902470 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:05.902432    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:33:05.902778 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:05.902734    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" podUID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" containerName="payload-processing" containerID="cri-o://5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0" gracePeriod=30
Jul 29 18:33:05.943260 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:05.943224    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:33:05.943492 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:05.943467    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" podUID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" containerName="payload-pre-processing" containerID="cri-o://a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a" gracePeriod=30
Jul 29 18:33:06.000339 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.000308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:06.083593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.083544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:06.167007 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.166940    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"]
Jul 29 18:33:06.173637 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.173590    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-8cd341-4gd88"]
Jul 29 18:33:06.243836 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.243808    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:33:06.247411 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.247378    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:33:06.336622 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.336583    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume\") pod \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") "
Jul 29 18:33:06.336810 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.336645    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngrh2\" (UniqueName: \"kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2\") pod \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") "
Jul 29 18:33:06.336810 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.336672    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume\") pod \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\" (UID: \"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3\") "
Jul 29 18:33:06.336810 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.336701    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sncxf\" (UniqueName: \"kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf\") pod \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\" (UID: \"af68b6fc-bdcb-4b0b-9068-3571339c5ad7\") "
Jul 29 18:33:06.337084 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.337061    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" (UID: "b2e2ba88-f0af-43d1-9151-9bd70bb86ce3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:33:06.337154 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.337063    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af68b6fc-bdcb-4b0b-9068-3571339c5ad7" (UID: "af68b6fc-bdcb-4b0b-9068-3571339c5ad7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:33:06.338914 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.338884    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf" (OuterVolumeSpecName: "kube-api-access-sncxf") pod "af68b6fc-bdcb-4b0b-9068-3571339c5ad7" (UID: "af68b6fc-bdcb-4b0b-9068-3571339c5ad7"). InnerVolumeSpecName "kube-api-access-sncxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:06.339035 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.338914    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2" (OuterVolumeSpecName: "kube-api-access-ngrh2") pod "b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" (UID: "b2e2ba88-f0af-43d1-9151-9bd70bb86ce3"). InnerVolumeSpecName "kube-api-access-ngrh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:06.438130 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.437979    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:06.438130 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.438010    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngrh2\" (UniqueName: \"kubernetes.io/projected/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-kube-api-access-ngrh2\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:06.438130 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.438020    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:06.438130 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.438030    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sncxf\" (UniqueName: \"kubernetes.io/projected/af68b6fc-bdcb-4b0b-9068-3571339c5ad7-kube-api-access-sncxf\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:06.439416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.439386    2563 generic.go:356] "Generic (PLEG): container finished" podID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" containerID="5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0" exitCode=0
Jul 29 18:33:06.439531 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.439437    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"
Jul 29 18:33:06.439531 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.439467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" event={"ID":"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3","Type":"ContainerDied","Data":"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"}
Jul 29 18:33:06.439600 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.439556    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng" event={"ID":"b2e2ba88-f0af-43d1-9151-9bd70bb86ce3","Type":"ContainerDied","Data":"92df3bf4faf283343ce534807c363fbb7a56aef0c28b7b2a2026bd4c18a5b337"}
Jul 29 18:33:06.439600 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.439584    2563 scope.go:117] "RemoveContainer" containerID="5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"
Jul 29 18:33:06.440925 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.440900    2563 generic.go:356] "Generic (PLEG): container finished" podID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" containerID="a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a" exitCode=0
Jul 29 18:33:06.441026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.440945    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" event={"ID":"af68b6fc-bdcb-4b0b-9068-3571339c5ad7","Type":"ContainerDied","Data":"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"}
Jul 29 18:33:06.441026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.440955    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"
Jul 29 18:33:06.441026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.440984    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k" event={"ID":"af68b6fc-bdcb-4b0b-9068-3571339c5ad7","Type":"ContainerDied","Data":"174feb46d43b37ad4cfe94997c7b8aa57517b6ad5fe51b5c32d03c81fa64ba14"}
Jul 29 18:33:06.448515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.448494    2563 scope.go:117] "RemoveContainer" containerID="5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"
Jul 29 18:33:06.448836 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:33:06.448813    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0\": container with ID starting with 5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0 not found: ID does not exist" containerID="5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"
Jul 29 18:33:06.448881 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.448851    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0"} err="failed to get container status \"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0\": rpc error: code = NotFound desc = could not find container \"5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0\": container with ID starting with 5708117afe794dc5485a3e879e8cb9ab7a99edf42211126d6719b94fc3beead0 not found: ID does not exist"
Jul 29 18:33:06.448881 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.448877    2563 scope.go:117] "RemoveContainer" containerID="a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"
Jul 29 18:33:06.457473 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.457453    2563 scope.go:117] "RemoveContainer" containerID="a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"
Jul 29 18:33:06.457802 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:33:06.457780    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a\": container with ID starting with a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a not found: ID does not exist" containerID="a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"
Jul 29 18:33:06.457883 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.457812    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a"} err="failed to get container status \"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a\": rpc error: code = NotFound desc = could not find container \"a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a\": container with ID starting with a95516e66a17b140ecee6008927644777d833ded497bbd11c84f4abb150c8a5a not found: ID does not exist"
Jul 29 18:33:06.469848 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.469805    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:33:06.474295 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.474261    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-8cd341-6bf89884d4-xxhng"]
Jul 29 18:33:06.486851 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.486822    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:33:06.490408 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.490385    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-8cd341-9b9b68fd8-ht95k"]
Jul 29 18:33:06.777227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.777115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:06.876622 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:06.876593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:07.586872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:07.586840    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5138e65d-db26-4e70-bd3b-6eefb345a1fe" path="/var/lib/kubelet/pods/5138e65d-db26-4e70-bd3b-6eefb345a1fe/volumes"
Jul 29 18:33:07.587230 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:07.587216    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" path="/var/lib/kubelet/pods/af68b6fc-bdcb-4b0b-9068-3571339c5ad7/volumes"
Jul 29 18:33:07.587559 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:07.587546    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" path="/var/lib/kubelet/pods/b2e2ba88-f0af-43d1-9151-9bd70bb86ce3/volumes"
Jul 29 18:33:12.400037 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.400003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:12.500951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.500914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:12.654944 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.654853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:12.867647 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.867616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:12.976589 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.976495    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"]
Jul 29 18:33:12.976968 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.976952    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" containerName="payload-pre-processing"
Jul 29 18:33:12.977019 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.976971    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" containerName="payload-pre-processing"
Jul 29 18:33:12.977019 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.976981    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" containerName="payload-processing"
Jul 29 18:33:12.977019 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.976987    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" containerName="payload-processing"
Jul 29 18:33:12.977019 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.977001    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5138e65d-db26-4e70-bd3b-6eefb345a1fe" containerName="revoke-keys"
Jul 29 18:33:12.977019 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.977007    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5138e65d-db26-4e70-bd3b-6eefb345a1fe" containerName="revoke-keys"
Jul 29 18:33:12.977166 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.977058    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e2ba88-f0af-43d1-9151-9bd70bb86ce3" containerName="payload-processing"
Jul 29 18:33:12.977166 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.977066    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af68b6fc-bdcb-4b0b-9068-3571339c5ad7" containerName="payload-pre-processing"
Jul 29 18:33:12.977166 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.977074    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5138e65d-db26-4e70-bd3b-6eefb345a1fe" containerName="revoke-keys"
Jul 29 18:33:12.981596 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.981576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:12.984213 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.984181    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:33:12.984358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.984319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:33:12.988129 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:12.988102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"]
Jul 29 18:33:13.100719 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.100675    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv\" (UID: \"3fb05d31-2c66-459c-8590-b54f78b4ffb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:13.201577 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.201543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv\" (UID: \"3fb05d31-2c66-459c-8590-b54f78b4ffb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:13.202208 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.202173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv\" (UID: \"3fb05d31-2c66-459c-8590-b54f78b4ffb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:13.294189 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.294099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:13.438913 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.438886    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"]
Jul 29 18:33:13.441061 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:33:13.441035    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb05d31_2c66_459c_8590_b54f78b4ffb7.slice/crio-849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7 WatchSource:0}: Error finding container 849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7: Status 404 returned error can't find the container with id 849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7
Jul 29 18:33:13.480722 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:13.480676    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv" event={"ID":"3fb05d31-2c66-459c-8590-b54f78b4ffb7","Type":"ContainerStarted","Data":"849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7"}
Jul 29 18:33:14.487058 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:14.486974    2563 generic.go:356] "Generic (PLEG): container finished" podID="3fb05d31-2c66-459c-8590-b54f78b4ffb7" containerID="f76cbc6e20ee9ec3f640a2cc5aa2e8bf20b6384a4cf27fee07716b4118d85d90" exitCode=0
Jul 29 18:33:14.487453 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:14.487068    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv" event={"ID":"3fb05d31-2c66-459c-8590-b54f78b4ffb7","Type":"ContainerDied","Data":"f76cbc6e20ee9ec3f640a2cc5aa2e8bf20b6384a4cf27fee07716b4118d85d90"}
Jul 29 18:33:15.638309 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:15.638278    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:15.723567 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:15.723522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca\") pod \"3fb05d31-2c66-459c-8590-b54f78b4ffb7\" (UID: \"3fb05d31-2c66-459c-8590-b54f78b4ffb7\") "
Jul 29 18:33:15.723917 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:15.723889    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3fb05d31-2c66-459c-8590-b54f78b4ffb7" (UID: "3fb05d31-2c66-459c-8590-b54f78b4ffb7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:33:15.824682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:15.824590    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3fb05d31-2c66-459c-8590-b54f78b4ffb7-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:16.498317 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:16.498274    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv" event={"ID":"3fb05d31-2c66-459c-8590-b54f78b4ffb7","Type":"ContainerDied","Data":"849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7"}
Jul 29 18:33:16.498512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:16.498331    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"
Jul 29 18:33:16.498512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:16.498369    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="849c5163ce8e3af1ba2a991466e19684236f8a42c6a3447b0eceb67b0ca6b6d7"
Jul 29 18:33:23.546267 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.546182    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:23.568094 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.568053    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:33:23.568348 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.568321    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" podUID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" containerName="payload-processing" containerID="cri-o://5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674" gracePeriod=30
Jul 29 18:33:23.578016 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.577985    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:33:23.579434 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.579383    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" podUID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" containerName="payload-pre-processing" containerID="cri-o://e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd" gracePeriod=30
Jul 29 18:33:23.620728 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.620697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:23.690383 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.690359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:23.725784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.725746    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"]
Jul 29 18:33:23.729857 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.729817    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-e6623d-r8gzv"]
Jul 29 18:33:23.759696 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.759656    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:23.875524 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.875501    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:33:23.878350 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.878327    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:33:23.999605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.999565    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d42gt\" (UniqueName: \"kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt\") pod \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") "
Jul 29 18:33:23.999798 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.999651    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume\") pod \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") "
Jul 29 18:33:23.999798 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.999694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume\") pod \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\" (UID: \"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2\") "
Jul 29 18:33:23.999798 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:23.999726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdgtb\" (UniqueName: \"kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb\") pod \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\" (UID: \"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22\") "
Jul 29 18:33:24.000159 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.000127    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" (UID: "a3ac9ac8-6012-4107-a1e5-7b1eb1fded22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:33:24.000312 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.000128    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" (UID: "ecc1035f-5cb4-4ecf-9306-34a5c27f73c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:33:24.002812 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.002780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt" (OuterVolumeSpecName: "kube-api-access-d42gt") pod "ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" (UID: "ecc1035f-5cb4-4ecf-9306-34a5c27f73c2"). InnerVolumeSpecName "kube-api-access-d42gt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:24.003253 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.003220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb" (OuterVolumeSpecName: "kube-api-access-jdgtb") pod "a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" (UID: "a3ac9ac8-6012-4107-a1e5-7b1eb1fded22"). InnerVolumeSpecName "kube-api-access-jdgtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:33:24.101328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.101283    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d42gt\" (UniqueName: \"kubernetes.io/projected/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-kube-api-access-d42gt\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:24.101328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.101319    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:24.101328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.101332    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:24.101652 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.101346    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdgtb\" (UniqueName: \"kubernetes.io/projected/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22-kube-api-access-jdgtb\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:33:24.127553 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.127492    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:24.540418 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.540322    2563 generic.go:356] "Generic (PLEG): container finished" podID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" containerID="5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674" exitCode=0
Jul 29 18:33:24.540418 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.540385    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"
Jul 29 18:33:24.540418 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.540403    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" event={"ID":"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22","Type":"ContainerDied","Data":"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"}
Jul 29 18:33:24.540738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.540488    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc" event={"ID":"a3ac9ac8-6012-4107-a1e5-7b1eb1fded22","Type":"ContainerDied","Data":"680f375ec1bae7cf2879229e4a2a41b7f593b0ee4b01368010f9e55264c181d8"}
Jul 29 18:33:24.540738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.540520    2563 scope.go:117] "RemoveContainer" containerID="5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"
Jul 29 18:33:24.541763 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.541739    2563 generic.go:356] "Generic (PLEG): container finished" podID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" containerID="e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd" exitCode=0
Jul 29 18:33:24.541873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.541789    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" event={"ID":"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2","Type":"ContainerDied","Data":"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"}
Jul 29 18:33:24.541873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.541802    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"
Jul 29 18:33:24.541873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.541831    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr" event={"ID":"ecc1035f-5cb4-4ecf-9306-34a5c27f73c2","Type":"ContainerDied","Data":"4c0cc7c0c1a7106047fac8231beb87bfa50cc5e4bfa6c135bffcd564625514ae"}
Jul 29 18:33:24.551068 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.551045    2563 scope.go:117] "RemoveContainer" containerID="5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"
Jul 29 18:33:24.551483 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:33:24.551463    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674\": container with ID starting with 5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674 not found: ID does not exist" containerID="5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"
Jul 29 18:33:24.551533 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.551494    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674"} err="failed to get container status \"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674\": rpc error: code = NotFound desc = could not find container \"5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674\": container with ID starting with 5a52f824349465cea7513df6dcc5605d7f50d6600dab53d50e26a7d503fdd674 not found: ID does not exist"
Jul 29 18:33:24.551533 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.551511    2563 scope.go:117] "RemoveContainer" containerID="e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"
Jul 29 18:33:24.559656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.559640    2563 scope.go:117] "RemoveContainer" containerID="e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"
Jul 29 18:33:24.559969 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:33:24.559944    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd\": container with ID starting with e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd not found: ID does not exist" containerID="e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"
Jul 29 18:33:24.560027 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.559982    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd"} err="failed to get container status \"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd\": rpc error: code = NotFound desc = could not find container \"e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd\": container with ID starting with e7b4b12335fb46c7b15ae4fe40e960658897f275c5bf298220f607ff7c1529dd not found: ID does not exist"
Jul 29 18:33:24.564395 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.564367    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:33:24.569401 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.569371    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-e6623d-7fd96cb6d8-vs6nc"]
Jul 29 18:33:24.585991 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.585958    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:33:24.592219 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:24.592182    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-e6623d-849578bfb4-8sncr"]
Jul 29 18:33:25.585897 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:25.585864    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fb05d31-2c66-459c-8590-b54f78b4ffb7" path="/var/lib/kubelet/pods/3fb05d31-2c66-459c-8590-b54f78b4ffb7/volumes"
Jul 29 18:33:25.586523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:25.586278    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" path="/var/lib/kubelet/pods/a3ac9ac8-6012-4107-a1e5-7b1eb1fded22/volumes"
Jul 29 18:33:25.586629 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:25.586615    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" path="/var/lib/kubelet/pods/ecc1035f-5cb4-4ecf-9306-34a5c27f73c2/volumes"
Jul 29 18:33:30.229398 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:30.229363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:30.300477 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:30.300440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:30.491536 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:30.491451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:30.711658 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:30.711625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:31.042066 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:31.042033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:31.369286 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:31.369239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:31.791754 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:31.791672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:34.108133 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:34.108094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:34.201684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:34.201655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:35.384366 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:35.384333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:35.664702 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:35.664603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:35.917713 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:35.917614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:36.014336 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.014305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:36.020992 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.020956    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:33:36.021348 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021335    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" containerName="payload-pre-processing"
Jul 29 18:33:36.021397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021349    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" containerName="payload-pre-processing"
Jul 29 18:33:36.021397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021360    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" containerName="payload-processing"
Jul 29 18:33:36.021397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021365    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" containerName="payload-processing"
Jul 29 18:33:36.021397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021372    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fb05d31-2c66-459c-8590-b54f78b4ffb7" containerName="revoke-keys"
Jul 29 18:33:36.021397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021379    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fb05d31-2c66-459c-8590-b54f78b4ffb7" containerName="revoke-keys"
Jul 29 18:33:36.021549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021440    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fb05d31-2c66-459c-8590-b54f78b4ffb7" containerName="revoke-keys"
Jul 29 18:33:36.021549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021449    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3ac9ac8-6012-4107-a1e5-7b1eb1fded22" containerName="payload-processing"
Jul 29 18:33:36.021549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.021456    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc1035f-5cb4-4ecf-9306-34a5c27f73c2" containerName="payload-pre-processing"
Jul 29 18:33:36.024363 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.024339    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.027148 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.027127    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-45bfe9\""
Jul 29 18:33:36.036722 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.036687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:33:36.040215 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.040170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:33:36.040349 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.040311    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.043375 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.043349    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-45bfe9-dockercfg-tqtf2\""
Jul 29 18:33:36.052031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.052003    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:33:36.118229 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.118155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4tc9\" (UniqueName: \"kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.118421 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.118356    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.219682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.219586    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.219682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.219650    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjxsn\" (UniqueName: \"kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.219682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.219685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.219969 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.219709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4tc9\" (UniqueName: \"kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.220347 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.220329    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.228524 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.228495    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4tc9\" (UniqueName: \"kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9\") pod \"payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") " pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.320706 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.320671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.320926 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.320812    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjxsn\" (UniqueName: \"kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.321428 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.321404    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.329566 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.329547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjxsn\" (UniqueName: \"kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn\") pod \"payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.335492 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.335467    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.351619 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.351589    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:36.495822 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.495791    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:33:36.497960 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:33:36.497931    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3137d9a_7c17_4bb0_b1a0_baf68931d81a.slice/crio-52a84ae06105ac942d03a9ac8a37293aedf118ed373ac35daef919357bcc6eba WatchSource:0}: Error finding container 52a84ae06105ac942d03a9ac8a37293aedf118ed373ac35daef919357bcc6eba: Status 404 returned error can't find the container with id 52a84ae06105ac942d03a9ac8a37293aedf118ed373ac35daef919357bcc6eba
Jul 29 18:33:36.524583 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.524561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:33:36.535461 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:33:36.535418    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf115ebdf_7f8c_4b24_af5b_c65a3ba390f0.slice/crio-6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b WatchSource:0}: Error finding container 6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b: Status 404 returned error can't find the container with id 6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b
Jul 29 18:33:36.608292 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.608261    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" event={"ID":"e3137d9a-7c17-4bb0-b1a0-baf68931d81a","Type":"ContainerStarted","Data":"7871e3e35d7489e58a4ecdab02544c0f4aba75ca07e3aa0ed4c7064ff9c33abf"}
Jul 29 18:33:36.608441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.608314    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" event={"ID":"e3137d9a-7c17-4bb0-b1a0-baf68931d81a","Type":"ContainerStarted","Data":"52a84ae06105ac942d03a9ac8a37293aedf118ed373ac35daef919357bcc6eba"}
Jul 29 18:33:36.608441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.608362    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:36.609965 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.609933    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" event={"ID":"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0","Type":"ContainerStarted","Data":"6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b"}
Jul 29 18:33:36.625012 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:36.624908    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" podStartSLOduration=0.624885636 podStartE2EDuration="624.885636ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:33:36.624334495 +0000 UTC m=+2439.597376676" watchObservedRunningTime="2026-07-29 18:33:36.624885636 +0000 UTC m=+2439.597927816"
Jul 29 18:33:37.617266 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:37.617226    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" event={"ID":"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0","Type":"ContainerStarted","Data":"cc6b2aabfa28fbfd0db699ae8d6e75f3be7ab2b493a53a5c960c0e98491c9ff0"}
Jul 29 18:33:37.617642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:37.617292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:37.636270 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:37.636187    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" podStartSLOduration=1.6361706169999999 podStartE2EDuration="1.636170617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:33:37.635544568 +0000 UTC m=+2440.608586832" watchObservedRunningTime="2026-07-29 18:33:37.636170617 +0000 UTC m=+2440.609212796"
Jul 29 18:33:47.620413 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:47.620382    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:33:48.624994 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:48.624968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:33:59.076767 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:59.076724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:59.537739 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:59.537701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:33:59.929215 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:33:59.929175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:00.281854 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:00.281772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:03.192777 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:03.192742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:03.282128 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:03.282093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:04.430896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:04.430861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:04.535703 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:04.535673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:04.943468 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:04.943435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:05.038939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.038897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:05.097779 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.097748    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:34:05.101269 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.101250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.105377 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.105354    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a19316-dockercfg-zltf4\""
Jul 29 18:34:05.105506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.105354    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a19316\""
Jul 29 18:34:05.113309 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.113283    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:34:05.127875 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.127829    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:34:05.133413 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.133384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.142436 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.142410    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:34:05.176643 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.176610    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.176951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.176652    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xmcm\" (UniqueName: \"kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.277642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.277558    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.277642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.277602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkfxc\" (UniqueName: \"kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.277828 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.277676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.277828 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.277702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xmcm\" (UniqueName: \"kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.278386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.278369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.286095 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.286072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xmcm\" (UniqueName: \"kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm\") pod \"payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") " pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.378583 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.378539    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.378787 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.378598    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkfxc\" (UniqueName: \"kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.379304 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.379285    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.387233 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.387186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkfxc\" (UniqueName: \"kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc\") pod \"payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.413508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.413409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:05.446252 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.446187    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.622736 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.622711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:34:05.624816 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:34:05.624790    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf61006c8_5dc6_4d10_938b_734eb8ef5977.slice/crio-77f88ca9a7ba7977d23868646cab4e5c031b7ab475cc38d151071b34b691e8cf WatchSource:0}: Error finding container 77f88ca9a7ba7977d23868646cab4e5c031b7ab475cc38d151071b34b691e8cf: Status 404 returned error can't find the container with id 77f88ca9a7ba7977d23868646cab4e5c031b7ab475cc38d151071b34b691e8cf
Jul 29 18:34:05.768385 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.768332    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" event={"ID":"f61006c8-5dc6-4d10-938b-734eb8ef5977","Type":"ContainerStarted","Data":"29b63bda09cda7f3abb80a310b01cf5692e27a178781c2c8dd564d7f6a3e9f43"}
Jul 29 18:34:05.768578 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.768452    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" event={"ID":"f61006c8-5dc6-4d10-938b-734eb8ef5977","Type":"ContainerStarted","Data":"77f88ca9a7ba7977d23868646cab4e5c031b7ab475cc38d151071b34b691e8cf"}
Jul 29 18:34:05.768578 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.768485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:05.799689 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.799660    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:34:05.800883 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:05.800797    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" podStartSLOduration=0.800780226 podStartE2EDuration="800.780226ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:05.799051503 +0000 UTC m=+2468.772093684" watchObservedRunningTime="2026-07-29 18:34:05.800780226 +0000 UTC m=+2468.773822406"
Jul 29 18:34:05.801555 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:34:05.801532    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406a531c_fa29_4d65_a574_9c69000256a4.slice/crio-ac876cdf5509bb2a213bbbf446e7d0c078f04e12cd3f53283c7a394efce58e72 WatchSource:0}: Error finding container ac876cdf5509bb2a213bbbf446e7d0c078f04e12cd3f53283c7a394efce58e72: Status 404 returned error can't find the container with id ac876cdf5509bb2a213bbbf446e7d0c078f04e12cd3f53283c7a394efce58e72
Jul 29 18:34:06.777186 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:06.777147    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" event={"ID":"406a531c-fa29-4d65-a574-9c69000256a4","Type":"ContainerStarted","Data":"06406059ef5e4e94ed665a3a9e78a1f26cf104c14d0f0b5ab3c38074b870035e"}
Jul 29 18:34:06.777673 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:06.777224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" event={"ID":"406a531c-fa29-4d65-a574-9c69000256a4","Type":"ContainerStarted","Data":"ac876cdf5509bb2a213bbbf446e7d0c078f04e12cd3f53283c7a394efce58e72"}
Jul 29 18:34:06.777673 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:06.777376    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:06.800140 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:06.800090    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" podStartSLOduration=1.80007174 podStartE2EDuration="1.80007174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:34:06.799104691 +0000 UTC m=+2469.772146871" watchObservedRunningTime="2026-07-29 18:34:06.80007174 +0000 UTC m=+2469.773113974"
Jul 29 18:34:16.780224 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:16.780172    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:34:17.784405 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:17.784374    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:34:29.562498 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:29.562455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:33.259674 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:33.259639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:51.678745 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.678662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:51.712642 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.712604    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:34:51.713506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.713469    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" podUID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" containerName="payload-processing" containerID="cri-o://cc6b2aabfa28fbfd0db699ae8d6e75f3be7ab2b493a53a5c960c0e98491c9ff0" gracePeriod=30
Jul 29 18:34:51.734169 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.726818    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:34:51.734682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.734652    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" podUID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" containerName="payload-pre-processing" containerID="cri-o://7871e3e35d7489e58a4ecdab02544c0f4aba75ca07e3aa0ed4c7064ff9c33abf" gracePeriod=30
Jul 29 18:34:51.754106 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.754073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:51.816157 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.816119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:51.887787 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:51.887744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:52.013738 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.013692    2563 generic.go:356] "Generic (PLEG): container finished" podID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" containerID="cc6b2aabfa28fbfd0db699ae8d6e75f3be7ab2b493a53a5c960c0e98491c9ff0" exitCode=0
Jul 29 18:34:52.013905 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.013769    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" event={"ID":"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0","Type":"ContainerDied","Data":"cc6b2aabfa28fbfd0db699ae8d6e75f3be7ab2b493a53a5c960c0e98491c9ff0"}
Jul 29 18:34:52.013905 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.013876    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9" event={"ID":"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0","Type":"ContainerDied","Data":"6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b"}
Jul 29 18:34:52.014045 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.013904    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6348664d07eacf9ee251c115b70c3886db6a919092f4a6b48ab459a94c35ef8b"
Jul 29 18:34:52.015704 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.015675    2563 generic.go:356] "Generic (PLEG): container finished" podID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" containerID="7871e3e35d7489e58a4ecdab02544c0f4aba75ca07e3aa0ed4c7064ff9c33abf" exitCode=0
Jul 29 18:34:52.015870 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.015755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" event={"ID":"e3137d9a-7c17-4bb0-b1a0-baf68931d81a","Type":"ContainerDied","Data":"7871e3e35d7489e58a4ecdab02544c0f4aba75ca07e3aa0ed4c7064ff9c33abf"}
Jul 29 18:34:52.023610 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.023579    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:34:52.060308 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.060277    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:34:52.113291 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.113178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4tc9\" (UniqueName: \"kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9\") pod \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") "
Jul 29 18:34:52.113474 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.113350    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume\") pod \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\" (UID: \"f115ebdf-7f8c-4b24-af5b-c65a3ba390f0\") "
Jul 29 18:34:52.113745 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.113720    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" (UID: "f115ebdf-7f8c-4b24-af5b-c65a3ba390f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:34:52.115527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.115500    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9" (OuterVolumeSpecName: "kube-api-access-g4tc9") pod "f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" (UID: "f115ebdf-7f8c-4b24-af5b-c65a3ba390f0"). InnerVolumeSpecName "kube-api-access-g4tc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:34:52.214313 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.214270    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjxsn\" (UniqueName: \"kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn\") pod \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") "
Jul 29 18:34:52.214498 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.214372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume\") pod \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\" (UID: \"e3137d9a-7c17-4bb0-b1a0-baf68931d81a\") "
Jul 29 18:34:52.214566 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.214554    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4tc9\" (UniqueName: \"kubernetes.io/projected/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-kube-api-access-g4tc9\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:34:52.214615 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.214568    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:34:52.214749 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.214726    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3137d9a-7c17-4bb0-b1a0-baf68931d81a" (UID: "e3137d9a-7c17-4bb0-b1a0-baf68931d81a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:34:52.216517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.216490    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn" (OuterVolumeSpecName: "kube-api-access-jjxsn") pod "e3137d9a-7c17-4bb0-b1a0-baf68931d81a" (UID: "e3137d9a-7c17-4bb0-b1a0-baf68931d81a"). InnerVolumeSpecName "kube-api-access-jjxsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:34:52.228578 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.228486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:52.315736 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.315696    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:34:52.315736 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:52.315728    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjxsn\" (UniqueName: \"kubernetes.io/projected/e3137d9a-7c17-4bb0-b1a0-baf68931d81a-kube-api-access-jjxsn\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:34:53.022698 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.022610    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"
Jul 29 18:34:53.022698 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.022644    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl" event={"ID":"e3137d9a-7c17-4bb0-b1a0-baf68931d81a","Type":"ContainerDied","Data":"52a84ae06105ac942d03a9ac8a37293aedf118ed373ac35daef919357bcc6eba"}
Jul 29 18:34:53.023206 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.022717    2563 scope.go:117] "RemoveContainer" containerID="7871e3e35d7489e58a4ecdab02544c0f4aba75ca07e3aa0ed4c7064ff9c33abf"
Jul 29 18:34:53.023206 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.022852    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"
Jul 29 18:34:53.051534 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.051496    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:34:53.062068 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.062030    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-45bfe9-55fc46b55b-2h2hl"]
Jul 29 18:34:53.074211 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.074168    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:34:53.078639 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.078604    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-45bfe9-5fc47d79d6-zwkg9"]
Jul 29 18:34:53.587978 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.587946    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" path="/var/lib/kubelet/pods/e3137d9a-7c17-4bb0-b1a0-baf68931d81a/volumes"
Jul 29 18:34:53.588362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:53.588348    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" path="/var/lib/kubelet/pods/f115ebdf-7f8c-4b24-af5b-c65a3ba390f0/volumes"
Jul 29 18:34:58.178440 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.178398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:58.291514 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.291480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:58.403693 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.403655    2563 scope.go:117] "RemoveContainer" containerID="db2757c882e81aae888a655645ed91dfb73787b8317a7f05aa7bdacc141554ef"
Jul 29 18:34:58.477760 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.477639    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:58.702322 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.702285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:34:58.822993 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.822907    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"]
Jul 29 18:34:58.823321 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823308    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" containerName="payload-pre-processing"
Jul 29 18:34:58.823386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823322    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" containerName="payload-pre-processing"
Jul 29 18:34:58.823386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823339    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" containerName="payload-processing"
Jul 29 18:34:58.823386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823346    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" containerName="payload-processing"
Jul 29 18:34:58.823488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823414    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3137d9a-7c17-4bb0-b1a0-baf68931d81a" containerName="payload-pre-processing"
Jul 29 18:34:58.823488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.823424    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f115ebdf-7f8c-4b24-af5b-c65a3ba390f0" containerName="payload-processing"
Jul 29 18:34:58.828045 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.828023    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:34:58.831056 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.831032    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:34:58.831207 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.831061    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:34:58.836742 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.836715    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"]
Jul 29 18:34:58.980654 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:58.980616    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a19316-9krcf\" (UID: \"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:34:59.081759 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:59.081667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a19316-9krcf\" (UID: \"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:34:59.082308 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:59.082286    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a19316-9krcf\" (UID: \"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:34:59.140978 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:59.140930    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:34:59.287385 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:34:59.287344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"]
Jul 29 18:34:59.290212 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:34:59.290172    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce50ede_d6a5_482d_bd6e_8eb4b6fae7eb.slice/crio-f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea WatchSource:0}: Error finding container f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea: Status 404 returned error can't find the container with id f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea
Jul 29 18:35:00.063147 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:00.063105    2563 generic.go:356] "Generic (PLEG): container finished" podID="4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" containerID="9b8414ee9659a0c0b80d09fb7744d579e4ebb96858e954d96554e00c9cdf11d2" exitCode=0
Jul 29 18:35:00.063386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:00.063211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf" event={"ID":"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb","Type":"ContainerDied","Data":"9b8414ee9659a0c0b80d09fb7744d579e4ebb96858e954d96554e00c9cdf11d2"}
Jul 29 18:35:00.063386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:00.063277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf" event={"ID":"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb","Type":"ContainerStarted","Data":"f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea"}
Jul 29 18:35:01.217909 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:01.217880    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:35:01.399959 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:01.399920    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca\") pod \"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb\" (UID: \"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb\") "
Jul 29 18:35:01.400326 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:01.400303    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" (UID: "4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:35:01.500836 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:01.500796    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:35:02.075676 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:02.075643    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"
Jul 29 18:35:02.075889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:02.075681    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf" event={"ID":"4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb","Type":"ContainerDied","Data":"f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea"}
Jul 29 18:35:02.075889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:02.075730    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f9b24b0f9411b650949558b39084c3f1e8c619f9de5e4c21a5b0ff72bcb4b3ea"
Jul 29 18:35:07.948833 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:07.948794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:07.972395 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:07.972359    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:35:07.972679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:07.972653    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" podUID="406a531c-fa29-4d65-a574-9c69000256a4" containerName="payload-processing" containerID="cri-o://06406059ef5e4e94ed665a3a9e78a1f26cf104c14d0f0b5ab3c38074b870035e" gracePeriod=30
Jul 29 18:35:07.984423 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:07.984391    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:35:07.984714 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:07.984656    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" podUID="f61006c8-5dc6-4d10-938b-734eb8ef5977" containerName="payload-pre-processing" containerID="cri-o://29b63bda09cda7f3abb80a310b01cf5692e27a178781c2c8dd564d7f6a3e9f43" gracePeriod=30
Jul 29 18:35:08.015610 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.015574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:08.078303 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.078268    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:08.110828 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.110794    2563 generic.go:356] "Generic (PLEG): container finished" podID="f61006c8-5dc6-4d10-938b-734eb8ef5977" containerID="29b63bda09cda7f3abb80a310b01cf5692e27a178781c2c8dd564d7f6a3e9f43" exitCode=0
Jul 29 18:35:08.110828 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.110828    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" event={"ID":"f61006c8-5dc6-4d10-938b-734eb8ef5977","Type":"ContainerDied","Data":"29b63bda09cda7f3abb80a310b01cf5692e27a178781c2c8dd564d7f6a3e9f43"}
Jul 29 18:35:08.112548 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.112518    2563 generic.go:356] "Generic (PLEG): container finished" podID="406a531c-fa29-4d65-a574-9c69000256a4" containerID="06406059ef5e4e94ed665a3a9e78a1f26cf104c14d0f0b5ab3c38074b870035e" exitCode=0
Jul 29 18:35:08.112710 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.112567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" event={"ID":"406a531c-fa29-4d65-a574-9c69000256a4","Type":"ContainerDied","Data":"06406059ef5e4e94ed665a3a9e78a1f26cf104c14d0f0b5ab3c38074b870035e"}
Jul 29 18:35:08.124856 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.124792    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"]
Jul 29 18:35:08.127112 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.127082    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a19316-9krcf"]
Jul 29 18:35:08.148850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.148819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:08.281039 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.281011    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:35:08.283629 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.283610    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:35:08.363245 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363185    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume\") pod \"406a531c-fa29-4d65-a574-9c69000256a4\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") "
Jul 29 18:35:08.363437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363287    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume\") pod \"f61006c8-5dc6-4d10-938b-734eb8ef5977\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") "
Jul 29 18:35:08.363437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363311    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkfxc\" (UniqueName: \"kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc\") pod \"f61006c8-5dc6-4d10-938b-734eb8ef5977\" (UID: \"f61006c8-5dc6-4d10-938b-734eb8ef5977\") "
Jul 29 18:35:08.363437 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363373    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xmcm\" (UniqueName: \"kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm\") pod \"406a531c-fa29-4d65-a574-9c69000256a4\" (UID: \"406a531c-fa29-4d65-a574-9c69000256a4\") "
Jul 29 18:35:08.363779 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363738    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f61006c8-5dc6-4d10-938b-734eb8ef5977" (UID: "f61006c8-5dc6-4d10-938b-734eb8ef5977"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:35:08.363779 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.363767    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "406a531c-fa29-4d65-a574-9c69000256a4" (UID: "406a531c-fa29-4d65-a574-9c69000256a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:35:08.365721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.365693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc" (OuterVolumeSpecName: "kube-api-access-nkfxc") pod "f61006c8-5dc6-4d10-938b-734eb8ef5977" (UID: "f61006c8-5dc6-4d10-938b-734eb8ef5977"). InnerVolumeSpecName "kube-api-access-nkfxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:35:08.365826 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.365733    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm" (OuterVolumeSpecName: "kube-api-access-7xmcm") pod "406a531c-fa29-4d65-a574-9c69000256a4" (UID: "406a531c-fa29-4d65-a574-9c69000256a4"). InnerVolumeSpecName "kube-api-access-7xmcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:35:08.465177 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.465136    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f61006c8-5dc6-4d10-938b-734eb8ef5977-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:35:08.465177 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.465173    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkfxc\" (UniqueName: \"kubernetes.io/projected/f61006c8-5dc6-4d10-938b-734eb8ef5977-kube-api-access-nkfxc\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:35:08.465399 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.465188    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xmcm\" (UniqueName: \"kubernetes.io/projected/406a531c-fa29-4d65-a574-9c69000256a4-kube-api-access-7xmcm\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:35:08.465399 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.465217    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/406a531c-fa29-4d65-a574-9c69000256a4-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:35:08.532783 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:08.532690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:09.120327 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.120294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6" event={"ID":"406a531c-fa29-4d65-a574-9c69000256a4","Type":"ContainerDied","Data":"ac876cdf5509bb2a213bbbf446e7d0c078f04e12cd3f53283c7a394efce58e72"}
Jul 29 18:35:09.120327 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.120314    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"
Jul 29 18:35:09.120881 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.120369    2563 scope.go:117] "RemoveContainer" containerID="06406059ef5e4e94ed665a3a9e78a1f26cf104c14d0f0b5ab3c38074b870035e"
Jul 29 18:35:09.121740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.121696    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"
Jul 29 18:35:09.121740 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.121701    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s" event={"ID":"f61006c8-5dc6-4d10-938b-734eb8ef5977","Type":"ContainerDied","Data":"77f88ca9a7ba7977d23868646cab4e5c031b7ab475cc38d151071b34b691e8cf"}
Jul 29 18:35:09.132061 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.132037    2563 scope.go:117] "RemoveContainer" containerID="29b63bda09cda7f3abb80a310b01cf5692e27a178781c2c8dd564d7f6a3e9f43"
Jul 29 18:35:09.143530 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.143502    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:35:09.151467 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.151432    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-a19316-6c8cf6f48-zdlp6"]
Jul 29 18:35:09.181698 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.181656    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:35:09.183353 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.183326    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a19316-69b58cc956-pxr6s"]
Jul 29 18:35:09.586344 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.586309    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="406a531c-fa29-4d65-a574-9c69000256a4" path="/var/lib/kubelet/pods/406a531c-fa29-4d65-a574-9c69000256a4/volumes"
Jul 29 18:35:09.586654 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.586642    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" path="/var/lib/kubelet/pods/4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb/volumes"
Jul 29 18:35:09.586951 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:09.586940    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f61006c8-5dc6-4d10-938b-734eb8ef5977" path="/var/lib/kubelet/pods/f61006c8-5dc6-4d10-938b-734eb8ef5977/volumes"
Jul 29 18:35:14.531183 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:14.531146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:14.630105 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:14.630051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:14.783710 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:14.783625    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:14.988709 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:14.988676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:15.308358 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:15.308319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:15.622648 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:15.622612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:15.747382 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:15.747343    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:18.610425 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:18.610388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:18.706882 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:18.706853    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:19.909008 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:19.908977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:20.079137 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.079102    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:20.503721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.503687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:35:20.504069 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504056    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f61006c8-5dc6-4d10-938b-734eb8ef5977" containerName="payload-pre-processing"
Jul 29 18:35:20.504124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504071    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f61006c8-5dc6-4d10-938b-734eb8ef5977" containerName="payload-pre-processing"
Jul 29 18:35:20.504124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504082    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="406a531c-fa29-4d65-a574-9c69000256a4" containerName="payload-processing"
Jul 29 18:35:20.504124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504091    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="406a531c-fa29-4d65-a574-9c69000256a4" containerName="payload-processing"
Jul 29 18:35:20.504124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504112    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" containerName="revoke-keys"
Jul 29 18:35:20.504124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504118    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" containerName="revoke-keys"
Jul 29 18:35:20.504301 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504174    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f61006c8-5dc6-4d10-938b-734eb8ef5977" containerName="payload-pre-processing"
Jul 29 18:35:20.504301 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504185    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="406a531c-fa29-4d65-a574-9c69000256a4" containerName="payload-processing"
Jul 29 18:35:20.504301 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.504206    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce50ede-d6a5-482d-bd6e-8eb4b6fae7eb" containerName="revoke-keys"
Jul 29 18:35:20.508737 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.508710    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.511591 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.511560    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-297c4d-dockercfg-dbqxg\""
Jul 29 18:35:20.511741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.511653    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-297c4d\""
Jul 29 18:35:20.512261 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.512240    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:35:20.515560 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.515538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.524454 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.524419    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:35:20.528968 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.528940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:35:20.576861 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.576829    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km6xf\" (UniqueName: \"kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.577047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.576897    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.577047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.576981    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz7gn\" (UniqueName: \"kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.577047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.577025    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.677667 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.677624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km6xf\" (UniqueName: \"kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.677839 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.677758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.677839 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.677800    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz7gn\" (UniqueName: \"kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.677839 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.677827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.678593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.678566    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.678701 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.678659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.686901 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.686875    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km6xf\" (UniqueName: \"kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf\") pod \"payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.687002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.686919    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz7gn\" (UniqueName: \"kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn\") pod \"payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.821393 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.821279    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:20.831656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.831623    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:20.986386 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:20.986344    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:35:20.991764 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:35:20.991726    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c72dd9_9946_4887_b75f_6c2f9050aa48.slice/crio-0cba30c831c3f98974788ff3b0ab66eeb3f7a779d41d9649ec8f16079240aeb1 WatchSource:0}: Error finding container 0cba30c831c3f98974788ff3b0ab66eeb3f7a779d41d9649ec8f16079240aeb1: Status 404 returned error can't find the container with id 0cba30c831c3f98974788ff3b0ab66eeb3f7a779d41d9649ec8f16079240aeb1
Jul 29 18:35:21.022891 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.022866    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:35:21.024796 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:35:21.024770    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf58af3d_61b8_4634_b8a1_b49b0031a7f1.slice/crio-f0864e523219aecf46f387770c3ed28045e90f91a16aa62262d2f05df2f27b6b WatchSource:0}: Error finding container f0864e523219aecf46f387770c3ed28045e90f91a16aa62262d2f05df2f27b6b: Status 404 returned error can't find the container with id f0864e523219aecf46f387770c3ed28045e90f91a16aa62262d2f05df2f27b6b
Jul 29 18:35:21.053009 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.052977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:21.153152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.153120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:21.185163 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.185126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" event={"ID":"e5c72dd9-9946-4887-b75f-6c2f9050aa48","Type":"ContainerStarted","Data":"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"}
Jul 29 18:35:21.185379 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.185340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:21.185450 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.185380    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" event={"ID":"e5c72dd9-9946-4887-b75f-6c2f9050aa48","Type":"ContainerStarted","Data":"0cba30c831c3f98974788ff3b0ab66eeb3f7a779d41d9649ec8f16079240aeb1"}
Jul 29 18:35:21.187023 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.186998    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" event={"ID":"af58af3d-61b8-4634-b8a1-b49b0031a7f1","Type":"ContainerStarted","Data":"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"}
Jul 29 18:35:21.187170 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.187046    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" event={"ID":"af58af3d-61b8-4634-b8a1-b49b0031a7f1","Type":"ContainerStarted","Data":"f0864e523219aecf46f387770c3ed28045e90f91a16aa62262d2f05df2f27b6b"}
Jul 29 18:35:21.187170 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.187073    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:21.203650 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.203584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" podStartSLOduration=1.203565386 podStartE2EDuration="1.203565386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:21.201907435 +0000 UTC m=+2544.174949627" watchObservedRunningTime="2026-07-29 18:35:21.203565386 +0000 UTC m=+2544.176607565"
Jul 29 18:35:21.220633 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:21.220577    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" podStartSLOduration=1.220561005 podStartE2EDuration="1.220561005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:21.21866119 +0000 UTC m=+2544.191703394" watchObservedRunningTime="2026-07-29 18:35:21.220561005 +0000 UTC m=+2544.193603185"
Jul 29 18:35:32.194084 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:32.194053    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:35:32.194695 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:32.194239    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:35:43.570860 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:43.570820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:43.889551 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:43.889513    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:44.207381 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:44.207288    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:44.382458 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:44.382425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:46.788974 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:46.788929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:46.885363 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:46.885332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:47.922955 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:47.922922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:48.400774 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.400743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:48.502167 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.502112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:48.523124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.523085    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:35:48.526685 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.526663    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.529359 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.529328    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-f9520e-dockercfg-d77hc\""
Jul 29 18:35:48.529359 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.529329    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-f9520e\""
Jul 29 18:35:48.538217 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.538175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:35:48.541430 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.541399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7crz8\" (UniqueName: \"kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.541555 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.541525    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.555438 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.555401    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:35:48.558814 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.558785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.574002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.573972    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:35:48.599512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.599482    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:35:48.642040 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.642001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.642236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.642057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.642236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.642092    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7crz8\" (UniqueName: \"kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.642236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.642159    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbzth\" (UniqueName: \"kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.642784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.642765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.651987 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.651910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7crz8\" (UniqueName: \"kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8\") pod \"payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.743065 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.743015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbzth\" (UniqueName: \"kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.743305 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.743121    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.743873 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.743854    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.751817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.751793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbzth\" (UniqueName: \"kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth\") pod \"payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") " pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:48.838844 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.838810    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:48.869493 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:48.869460    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:49.026680 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.026640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:35:49.027895 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:35:49.027856    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d62c363_a166_4020_b952_6eb18ddb0763.slice/crio-64c946a37049b5d426b8a5f6f66f1048b10bd57b67871955102f71745c1b3515 WatchSource:0}: Error finding container 64c946a37049b5d426b8a5f6f66f1048b10bd57b67871955102f71745c1b3515: Status 404 returned error can't find the container with id 64c946a37049b5d426b8a5f6f66f1048b10bd57b67871955102f71745c1b3515
Jul 29 18:35:49.062854 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.062417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:35:49.065759 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:35:49.065726    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e2ac1_7615_4c7b_a15c_fc177027e3a7.slice/crio-ac950fa1838a120c9a095636e1225022ec0648dff44f2d95430495a20241989c WatchSource:0}: Error finding container ac950fa1838a120c9a095636e1225022ec0648dff44f2d95430495a20241989c: Status 404 returned error can't find the container with id ac950fa1838a120c9a095636e1225022ec0648dff44f2d95430495a20241989c
Jul 29 18:35:49.340838 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.340798    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" event={"ID":"4d62c363-a166-4020-b952-6eb18ddb0763","Type":"ContainerStarted","Data":"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"}
Jul 29 18:35:49.341021 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.340895    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" event={"ID":"4d62c363-a166-4020-b952-6eb18ddb0763","Type":"ContainerStarted","Data":"64c946a37049b5d426b8a5f6f66f1048b10bd57b67871955102f71745c1b3515"}
Jul 29 18:35:49.341021 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.340924    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:35:49.342362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.342328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" event={"ID":"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7","Type":"ContainerStarted","Data":"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"}
Jul 29 18:35:49.342479 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.342370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" event={"ID":"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7","Type":"ContainerStarted","Data":"ac950fa1838a120c9a095636e1225022ec0648dff44f2d95430495a20241989c"}
Jul 29 18:35:49.342479 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.342416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:35:49.368313 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.368143    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" podStartSLOduration=1.368123159 podStartE2EDuration="1.368123159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:49.367515071 +0000 UTC m=+2572.340557252" watchObservedRunningTime="2026-07-29 18:35:49.368123159 +0000 UTC m=+2572.341165344"
Jul 29 18:35:49.385791 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:35:49.385723    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" podStartSLOduration=1.3857027579999999 podStartE2EDuration="1.385702758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:35:49.385016936 +0000 UTC m=+2572.358059120" watchObservedRunningTime="2026-07-29 18:35:49.385702758 +0000 UTC m=+2572.358744940"
Jul 29 18:36:00.350082 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:00.350050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:36:00.350510 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:00.350226    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:36:10.401558 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:10.401521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:36:11.757495 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:11.757460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:36:21.975277 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:21.975176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:36:24.748684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:24.748641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:36:43.257958 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:36:43.257916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:37:16.421851 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:37:16.421817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:37:57.914408 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:37:57.914318    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:37:57.917535 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:37:57.917509    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:37:57.922509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:37:57.922481    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:37:57.925585 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:37:57.925564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:38:19.284452 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:38:19.284419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:38:58.461550 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:38:58.461422    2563 scope.go:117] "RemoveContainer" containerID="2ddded2247145abc26c1244f8d56094b8566e1a106163685a86144a50c7ed892"
Jul 29 18:39:27.288542 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:39:27.288459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:39:27.387894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:39:27.387866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:39:58.482179 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:39:58.482148    2563 scope.go:117] "RemoveContainer" containerID="f76cbc6e20ee9ec3f640a2cc5aa2e8bf20b6384a4cf27fee07716b4118d85d90"
Jul 29 18:39:58.490773 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:39:58.490755    2563 scope.go:117] "RemoveContainer" containerID="cc6b2aabfa28fbfd0db699ae8d6e75f3be7ab2b493a53a5c960c0e98491c9ff0"
Jul 29 18:40:03.083127 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:40:03.083089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:40:17.250160 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:40:17.250106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:40:17.359134 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:40:17.359100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:41:21.649272 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:41:21.649239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:41:22.712974 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:41:22.712928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:41:31.057611 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:41:31.057570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:41:58.521236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:41:58.521183    2563 scope.go:117] "RemoveContainer" containerID="9b8414ee9659a0c0b80d09fb7744d579e4ebb96858e954d96554e00c9cdf11d2"
Jul 29 18:42:06.450118 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:42:06.450073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:42:57.943936 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:42:57.943891    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:42:57.946964 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:42:57.946940    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:42:57.952469 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:42:57.952444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:42:57.955318 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:42:57.955295    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:43:19.881394 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:43:19.881351    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:43:19.936604 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:43:19.936559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:43:42.411960 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:43:42.411925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:43:43.439380 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:43:43.439326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:44:00.911215 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:44:00.911154    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:44:38.326691 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:44:38.326648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:45:00.132816 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.132779    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"]
Jul 29 18:45:00.136506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.136483    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"
Jul 29 18:45:00.136683 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.136523    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"]
Jul 29 18:45:00.139251 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.139226    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:45:00.140151 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.140130    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"
Jul 29 18:45:00.148066 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.147984    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"]
Jul 29 18:45:00.148726 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.148702    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"
Jul 29 18:45:00.150656 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.150630    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"]
Jul 29 18:45:00.158452 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.158427    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"
Jul 29 18:45:00.317079 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.317050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"]
Jul 29 18:45:00.320252 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:45:00.320219    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f505b8_a05d_4f3c_80d6_508e39cb2e47.slice/crio-f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937 WatchSource:0}: Error finding container f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937: Status 404 returned error can't find the container with id f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937
Jul 29 18:45:00.352750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:00.352719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"]
Jul 29 18:45:00.354057 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:45:00.354030    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda880cd0c_0228_425b_9f31_a44d8dce58cb.slice/crio-c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14 WatchSource:0}: Error finding container c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14: Status 404 returned error can't find the container with id c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14
Jul 29 18:45:01.204908 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.204869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh" event={"ID":"b1f505b8-a05d-4f3c-80d6-508e39cb2e47","Type":"ContainerStarted","Data":"e1adc3b87bd4a4d403b0df885d81ceea521944e662e44f118db78fb76b20d60b"}
Jul 29 18:45:01.205424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.204935    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh" event={"ID":"b1f505b8-a05d-4f3c-80d6-508e39cb2e47","Type":"ContainerStarted","Data":"f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937"}
Jul 29 18:45:01.206542 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.206510    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847" event={"ID":"a880cd0c-0228-425b-9f31-a44d8dce58cb","Type":"ContainerStarted","Data":"34982571280db02b4693bee6f042783780e138880d93b85ec7c40fedc4ae6146"}
Jul 29 18:45:01.206659 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.206564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847" event={"ID":"a880cd0c-0228-425b-9f31-a44d8dce58cb","Type":"ContainerStarted","Data":"c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14"}
Jul 29 18:45:01.221072 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.221017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh" podStartSLOduration=1.220999688 podStartE2EDuration="1.220999688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:45:01.219870917 +0000 UTC m=+3124.192913097" watchObservedRunningTime="2026-07-29 18:45:01.220999688 +0000 UTC m=+3124.194041884"
Jul 29 18:45:01.234438 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:01.234387    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847" podStartSLOduration=1.234369654 podStartE2EDuration="1.234369654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:45:01.233314469 +0000 UTC m=+3124.206356673" watchObservedRunningTime="2026-07-29 18:45:01.234369654 +0000 UTC m=+3124.207411833"
Jul 29 18:45:02.213515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:02.213480    2563 generic.go:356] "Generic (PLEG): container finished" podID="b1f505b8-a05d-4f3c-80d6-508e39cb2e47" containerID="e1adc3b87bd4a4d403b0df885d81ceea521944e662e44f118db78fb76b20d60b" exitCode=0
Jul 29 18:45:02.213942 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:02.213566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh" event={"ID":"b1f505b8-a05d-4f3c-80d6-508e39cb2e47","Type":"ContainerDied","Data":"e1adc3b87bd4a4d403b0df885d81ceea521944e662e44f118db78fb76b20d60b"}
Jul 29 18:45:02.215175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:02.215148    2563 generic.go:356] "Generic (PLEG): container finished" podID="a880cd0c-0228-425b-9f31-a44d8dce58cb" containerID="34982571280db02b4693bee6f042783780e138880d93b85ec7c40fedc4ae6146" exitCode=0
Jul 29 18:45:02.215301 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:02.215189    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847" event={"ID":"a880cd0c-0228-425b-9f31-a44d8dce58cb","Type":"ContainerDied","Data":"34982571280db02b4693bee6f042783780e138880d93b85ec7c40fedc4ae6146"}
Jul 29 18:45:03.376752 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:03.376725    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"
Jul 29 18:45:03.401828 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:03.401803    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"
Jul 29 18:45:04.226863 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.226832    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh" event={"ID":"b1f505b8-a05d-4f3c-80d6-508e39cb2e47","Type":"ContainerDied","Data":"f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937"}
Jul 29 18:45:04.227083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.226890    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f32750e56b28c566ad9e018e9b6deeb2ee05ce4da769b2d3bc754a5fcd3a9937"
Jul 29 18:45:04.227083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.226840    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"
Jul 29 18:45:04.228178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.228156    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"
Jul 29 18:45:04.228337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.228149    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847" event={"ID":"a880cd0c-0228-425b-9f31-a44d8dce58cb","Type":"ContainerDied","Data":"c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14"}
Jul 29 18:45:04.228337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:04.228248    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c760982242035606fe02fd61fe7cd92fff1a63b0944f53652b0616e78200fc14"
Jul 29 18:45:53.162687 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:53.162638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:45:54.141017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:45:54.140982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:13.931560 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:13.931521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:14.238449 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:14.238361    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:14.548356 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:14.548271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:16.960244 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:16.960209    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:17.071572 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:17.071541    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:18.089043 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.089010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:18.222069 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.222030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:18.594535 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.594500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:18.690282 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.690252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:18.725664 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.725624    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:46:18.726031 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726019    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f505b8-a05d-4f3c-80d6-508e39cb2e47" containerName="cleanup"
Jul 29 18:46:18.726083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726032    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f505b8-a05d-4f3c-80d6-508e39cb2e47" containerName="cleanup"
Jul 29 18:46:18.726083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726042    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a880cd0c-0228-425b-9f31-a44d8dce58cb" containerName="cleanup"
Jul 29 18:46:18.726083 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726048    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a880cd0c-0228-425b-9f31-a44d8dce58cb" containerName="cleanup"
Jul 29 18:46:18.726175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726120    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f505b8-a05d-4f3c-80d6-508e39cb2e47" containerName="cleanup"
Jul 29 18:46:18.726175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.726129    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a880cd0c-0228-425b-9f31-a44d8dce58cb" containerName="cleanup"
Jul 29 18:46:18.729206 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.729174    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.732048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.732020    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-479e5c\""
Jul 29 18:46:18.732220 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.732107    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-479e5c-dockercfg-x2wwj\""
Jul 29 18:46:18.739095 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.739068    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:46:18.765369 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.765332    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:46:18.769124 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.769098    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.777939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.777910    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:46:18.866424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.866333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.866424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.866396    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.866674 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.866440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6hv9\" (UniqueName: \"kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.866674 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.866595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrm4w\" (UniqueName: \"kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.968109 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.968061    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6hv9\" (UniqueName: \"kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.968337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.968209    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrm4w\" (UniqueName: \"kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.968337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.968250    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.968337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.968318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.969230 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.969208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.969299 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.969277    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:18.976584 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.976551    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6hv9\" (UniqueName: \"kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9\") pod \"payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:18.976733 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:18.976633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrm4w\" (UniqueName: \"kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w\") pod \"payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:19.040843 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.040804    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:19.080327 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.080290    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:19.205835 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.205645    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:46:19.208385 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:46:19.208353    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf46e1e2_195a_4da6_b1ae_d84d2e48b309.slice/crio-18a91a1684983e504c6a7b6e9d687562ec00c3a56062808e4560cfdf54c171c3 WatchSource:0}: Error finding container 18a91a1684983e504c6a7b6e9d687562ec00c3a56062808e4560cfdf54c171c3: Status 404 returned error can't find the container with id 18a91a1684983e504c6a7b6e9d687562ec00c3a56062808e4560cfdf54c171c3
Jul 29 18:46:19.455441 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.455414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:46:19.457606 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:46:19.457578    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded614b3_8e47_4c1f_ab3d_2b85e4544e8a.slice/crio-11cc69b9e9e8080d64678db988a8d5b760f9de88c63669f8f84afdeb544a69dc WatchSource:0}: Error finding container 11cc69b9e9e8080d64678db988a8d5b760f9de88c63669f8f84afdeb544a69dc: Status 404 returned error can't find the container with id 11cc69b9e9e8080d64678db988a8d5b760f9de88c63669f8f84afdeb544a69dc
Jul 29 18:46:19.618683 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.618645    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" event={"ID":"cf46e1e2-195a-4da6-b1ae-d84d2e48b309","Type":"ContainerStarted","Data":"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"}
Jul 29 18:46:19.618865 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.618702    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" event={"ID":"cf46e1e2-195a-4da6-b1ae-d84d2e48b309","Type":"ContainerStarted","Data":"18a91a1684983e504c6a7b6e9d687562ec00c3a56062808e4560cfdf54c171c3"}
Jul 29 18:46:19.618865 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.618767    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:19.620350 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.620324    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" event={"ID":"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a","Type":"ContainerStarted","Data":"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"}
Jul 29 18:46:19.620468 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.620367    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" event={"ID":"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a","Type":"ContainerStarted","Data":"11cc69b9e9e8080d64678db988a8d5b760f9de88c63669f8f84afdeb544a69dc"}
Jul 29 18:46:19.620468 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.620386    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:19.635784 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.635728    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" podStartSLOduration=1.63571088 podStartE2EDuration="1.63571088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:46:19.633578931 +0000 UTC m=+3202.606621114" watchObservedRunningTime="2026-07-29 18:46:19.63571088 +0000 UTC m=+3202.608753059"
Jul 29 18:46:19.648273 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:19.648187    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" podStartSLOduration=1.648167938 podStartE2EDuration="1.648167938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:46:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:46:19.647538515 +0000 UTC m=+3202.620580718" watchObservedRunningTime="2026-07-29 18:46:19.648167938 +0000 UTC m=+3202.621210118"
Jul 29 18:46:30.627648 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:30.627616    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:46:30.628090 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:30.627692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:46:41.946104 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:41.946069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:42.829960 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:42.829904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:42.901175 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:42.901140    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:43.070451 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:43.070421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:45.397825 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:45.397785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:45.496639 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:45.496607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:46.528692 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:46.528658    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:46.628753 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:46.628725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:47.116756 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.116722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:47.214511 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.214475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:46:47.226394 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.226360    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:46:47.229850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.229830    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.232843 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.232818    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-b0fdf2-dockercfg-rjqlx\""
Jul 29 18:46:47.232980 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.232862    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-b0fdf2\""
Jul 29 18:46:47.243817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.243789    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:46:47.269625 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.269591    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:46:47.273337 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.273317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.284166 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.284137    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:46:47.327867 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.327811    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-746nm\" (UniqueName: \"kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.328048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.327875    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjd8h\" (UniqueName: \"kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.328048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.327994    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.328234 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.328137    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.429480 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.429381    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.429480 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.429438    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-746nm\" (UniqueName: \"kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.429730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.429556    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjd8h\" (UniqueName: \"kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.429730 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.429625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.430140 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.430119    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.430351 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.430334    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.438485 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.438461    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-746nm\" (UniqueName: \"kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm\") pod \"payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.438610 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.438549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjd8h\" (UniqueName: \"kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h\") pod \"payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.542206 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.542165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:47.585924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.585893    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:47.704683 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.704279    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:46:47.708573 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:46:47.708540    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64aafc34_7cf7_4f0c_b5e2_7d6f280767b7.slice/crio-2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b WatchSource:0}: Error finding container 2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b: Status 404 returned error can't find the container with id 2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b
Jul 29 18:46:47.761999 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.761962    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:46:47.765587 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:46:47.765549    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb04a9607_11c9_4091_93fd_0fc10766dc44.slice/crio-54ac0a03dbfab0b2a9ff6610132ae32e0fa0ecbcb2a87c0f1d43d5a1992df9a7 WatchSource:0}: Error finding container 54ac0a03dbfab0b2a9ff6610132ae32e0fa0ecbcb2a87c0f1d43d5a1992df9a7: Status 404 returned error can't find the container with id 54ac0a03dbfab0b2a9ff6610132ae32e0fa0ecbcb2a87c0f1d43d5a1992df9a7
Jul 29 18:46:47.768811 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:47.768779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" event={"ID":"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7","Type":"ContainerStarted","Data":"2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b"}
Jul 29 18:46:48.776728 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.776694    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" event={"ID":"b04a9607-11c9-4091-93fd-0fc10766dc44","Type":"ContainerStarted","Data":"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"}
Jul 29 18:46:48.777299 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.776753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" event={"ID":"b04a9607-11c9-4091-93fd-0fc10766dc44","Type":"ContainerStarted","Data":"54ac0a03dbfab0b2a9ff6610132ae32e0fa0ecbcb2a87c0f1d43d5a1992df9a7"}
Jul 29 18:46:48.777299 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.776811    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:48.778715 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.778685    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" event={"ID":"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7","Type":"ContainerStarted","Data":"1fa99a9168482c4f88293a7a6fd2a4990dcc73d4cf1d15f404a3fe7ce19b5da0"}
Jul 29 18:46:48.778856 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.778754    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:46:48.792918 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.792873    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" podStartSLOduration=1.792859964 podStartE2EDuration="1.792859964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:46:48.792062008 +0000 UTC m=+3231.765104213" watchObservedRunningTime="2026-07-29 18:46:48.792859964 +0000 UTC m=+3231.765902144"
Jul 29 18:46:48.807672 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:48.807614    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" podStartSLOduration=1.8075973360000002 podStartE2EDuration="1.807597336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:46:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:46:48.806641375 +0000 UTC m=+3231.779683576" watchObservedRunningTime="2026-07-29 18:46:48.807597336 +0000 UTC m=+3231.780639516"
Jul 29 18:46:59.786393 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:59.786359    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:46:59.786863 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:46:59.786493    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:47:12.240236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:12.240171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:47:17.047706 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:17.047667    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:47:17.162708 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:17.162675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d_b04a9607-11c9-4091-93fd-0fc10766dc44/payload-processing/0.log"
Jul 29 18:47:37.754325 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:37.754282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:47:57.984969 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:57.984935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:47:57.988012 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:57.987984    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:47:57.993227 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:57.993187    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:47:57.996006 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:47:57.995988    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95zhz_f1940aef-6f29-4cee-bad6-a861654593f1/ovn-acl-logging/0.log"
Jul 29 18:48:19.378851 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:19.378767    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448_cf46e1e2-195a-4da6-b1ae-d84d2e48b309/payload-processing/0.log"
Jul 29 18:48:19.498540 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:19.498514    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:48:19.617821 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:19.617792    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d_b04a9607-11c9-4091-93fd-0fc10766dc44/payload-processing/0.log"
Jul 29 18:48:20.905549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:20.905515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:20.982291 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:20.982254    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:23.698781 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:23.698738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:23.792342 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:23.792310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:24.823345 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:24.823297    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:25.092517 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.092480    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:25.427527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.427442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:25.528911 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.528871    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:25.530541 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.530515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:25.532741 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.532724    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.535389 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.535367    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-8b8f04\""
Jul 29 18:48:25.535495 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.535392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-8b8f04-dockercfg-c4vlg\""
Jul 29 18:48:25.543496 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.543472    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:25.570976 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.570939    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:25.575539 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.575518    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.589643 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.589618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:25.652554 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.652519    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.652729 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.652630    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z67nc\" (UniqueName: \"kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.652729 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.652698    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.652821 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.652728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9wkc\" (UniqueName: \"kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.753704 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.753588    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.753704 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.753649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9wkc\" (UniqueName: \"kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.753704 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.753693    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.754020 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.753753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z67nc\" (UniqueName: \"kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.754664 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.754638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.754736 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.754638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.762861 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.762818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9wkc\" (UniqueName: \"kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc\") pod \"payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.763126 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.763097    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z67nc\" (UniqueName: \"kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc\") pod \"payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:25.845373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.845341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:25.888331 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:25.888296    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:26.026850 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.026799    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:26.029421 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:48:26.029364    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec18b8e0_9578_4463_9828_a5363688e686.slice/crio-557b7fa58fa62623f876abffbf0b65a7791c7da6850eefc6cfb3ec7ad26ed16f WatchSource:0}: Error finding container 557b7fa58fa62623f876abffbf0b65a7791c7da6850eefc6cfb3ec7ad26ed16f: Status 404 returned error can't find the container with id 557b7fa58fa62623f876abffbf0b65a7791c7da6850eefc6cfb3ec7ad26ed16f
Jul 29 18:48:26.097159 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.097128    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:26.103376 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:48:26.103333    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7355219b_be7d_4f06_8966_119ab9535a74.slice/crio-62fd8dddc497b21e8bb3bc9e2cd7139d1dcf7fe9a2c9938c365ff9d297c6c24c WatchSource:0}: Error finding container 62fd8dddc497b21e8bb3bc9e2cd7139d1dcf7fe9a2c9938c365ff9d297c6c24c: Status 404 returned error can't find the container with id 62fd8dddc497b21e8bb3bc9e2cd7139d1dcf7fe9a2c9938c365ff9d297c6c24c
Jul 29 18:48:26.307896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.307787    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" event={"ID":"7355219b-be7d-4f06-8966-119ab9535a74","Type":"ContainerStarted","Data":"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"}
Jul 29 18:48:26.307896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.307858    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" event={"ID":"7355219b-be7d-4f06-8966-119ab9535a74","Type":"ContainerStarted","Data":"62fd8dddc497b21e8bb3bc9e2cd7139d1dcf7fe9a2c9938c365ff9d297c6c24c"}
Jul 29 18:48:26.307896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.307889    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:26.309503 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.309467    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" event={"ID":"ec18b8e0-9578-4463-9828-a5363688e686","Type":"ContainerStarted","Data":"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"}
Jul 29 18:48:26.309646 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.309513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" event={"ID":"ec18b8e0-9578-4463-9828-a5363688e686","Type":"ContainerStarted","Data":"557b7fa58fa62623f876abffbf0b65a7791c7da6850eefc6cfb3ec7ad26ed16f"}
Jul 29 18:48:26.309646 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.309551    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:26.326812 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.326760    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" podStartSLOduration=1.326741704 podStartE2EDuration="1.326741704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:48:26.325326028 +0000 UTC m=+3329.298368220" watchObservedRunningTime="2026-07-29 18:48:26.326741704 +0000 UTC m=+3329.299783883"
Jul 29 18:48:26.343497 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:26.343437    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" podStartSLOduration=1.343420043 podStartE2EDuration="1.343420043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:48:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:48:26.342834937 +0000 UTC m=+3329.315877119" watchObservedRunningTime="2026-07-29 18:48:26.343420043 +0000 UTC m=+3329.316462222"
Jul 29 18:48:37.316851 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:37.316818    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:37.317307 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:37.316893    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:38.401722 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:38.401686    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:39.059560 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.059518    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"]
Jul 29 18:48:39.063530 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.063510    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:39.066117 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.066089    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:48:39.066117 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.066104    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:48:39.070369 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.070331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"]
Jul 29 18:48:39.191185 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.191153    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj\" (UID: \"46ebc788-83d1-420a-ba85-28b9b435f407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:39.291803 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.291767    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj\" (UID: \"46ebc788-83d1-420a-ba85-28b9b435f407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:39.292498 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.292478    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj\" (UID: \"46ebc788-83d1-420a-ba85-28b9b435f407\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:39.377984 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.377947    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:39.535798 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:39.535764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"]
Jul 29 18:48:39.537551 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:48:39.537523    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ebc788_83d1_420a_ba85_28b9b435f407.slice/crio-7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4 WatchSource:0}: Error finding container 7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4: Status 404 returned error can't find the container with id 7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4
Jul 29 18:48:40.400163 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:40.400127    2563 generic.go:356] "Generic (PLEG): container finished" podID="46ebc788-83d1-420a-ba85-28b9b435f407" containerID="d79a297880ddbae3920849c28f8b4a62dcb83661d9fb1ed3ac7ac392452d5e9c" exitCode=0
Jul 29 18:48:40.400410 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:40.400233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj" event={"ID":"46ebc788-83d1-420a-ba85-28b9b435f407","Type":"ContainerDied","Data":"d79a297880ddbae3920849c28f8b4a62dcb83661d9fb1ed3ac7ac392452d5e9c"}
Jul 29 18:48:40.400410 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:40.400295    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj" event={"ID":"46ebc788-83d1-420a-ba85-28b9b435f407","Type":"ContainerStarted","Data":"7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4"}
Jul 29 18:48:41.561173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:41.561145    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:41.715236 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:41.715100    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca\") pod \"46ebc788-83d1-420a-ba85-28b9b435f407\" (UID: \"46ebc788-83d1-420a-ba85-28b9b435f407\") "
Jul 29 18:48:41.715601 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:41.715567    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46ebc788-83d1-420a-ba85-28b9b435f407" (UID: "46ebc788-83d1-420a-ba85-28b9b435f407"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:48:41.816497 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:41.816454    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46ebc788-83d1-420a-ba85-28b9b435f407-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:42.413027 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:42.412990    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"
Jul 29 18:48:42.413241 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:42.413031    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj" event={"ID":"46ebc788-83d1-420a-ba85-28b9b435f407","Type":"ContainerDied","Data":"7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4"}
Jul 29 18:48:42.413241 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:42.413095    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cf9fa844bd25ec784256cd3d08352425cbe412f71eea9862d50c2fe6e9e6bf4"
Jul 29 18:48:44.623632 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.623583    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:44.654375 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.654334    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:44.654649 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.654599    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" podUID="7355219b-be7d-4f06-8966-119ab9535a74" containerName="payload-processing" containerID="cri-o://56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2" gracePeriod=30
Jul 29 18:48:44.687078 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.687039    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:44.687311 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.687269    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" podUID="ec18b8e0-9578-4463-9828-a5363688e686" containerName="payload-pre-processing" containerID="cri-o://c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a" gracePeriod=30
Jul 29 18:48:44.725774 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.725741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:44.737298 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:48:44.737261    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec18b8e0_9578_4463_9828_a5363688e686.slice/crio-c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 18:48:44.737441 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:48:44.737365    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec18b8e0_9578_4463_9828_a5363688e686.slice/crio-conmon-c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 18:48:44.824076 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.824046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:44.923953 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.923916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:44.951937 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.951897    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"]
Jul 29 18:48:44.955765 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:44.955727    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-8b8f04-7rplj"]
Jul 29 18:48:45.004237 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.004184    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:45.007753 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.007728    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:45.149082 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume\") pod \"7355219b-be7d-4f06-8966-119ab9535a74\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") "
Jul 29 18:48:45.149302 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9wkc\" (UniqueName: \"kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc\") pod \"ec18b8e0-9578-4463-9828-a5363688e686\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") "
Jul 29 18:48:45.149302 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149152    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z67nc\" (UniqueName: \"kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc\") pod \"7355219b-be7d-4f06-8966-119ab9535a74\" (UID: \"7355219b-be7d-4f06-8966-119ab9535a74\") "
Jul 29 18:48:45.149302 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume\") pod \"ec18b8e0-9578-4463-9828-a5363688e686\" (UID: \"ec18b8e0-9578-4463-9828-a5363688e686\") "
Jul 29 18:48:45.149599 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149564    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7355219b-be7d-4f06-8966-119ab9535a74" (UID: "7355219b-be7d-4f06-8966-119ab9535a74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:48:45.149716 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.149678    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec18b8e0-9578-4463-9828-a5363688e686" (UID: "ec18b8e0-9578-4463-9828-a5363688e686"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:48:45.151428 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.151408    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc" (OuterVolumeSpecName: "kube-api-access-p9wkc") pod "ec18b8e0-9578-4463-9828-a5363688e686" (UID: "ec18b8e0-9578-4463-9828-a5363688e686"). InnerVolumeSpecName "kube-api-access-p9wkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:48:45.151512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.151435    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc" (OuterVolumeSpecName: "kube-api-access-z67nc") pod "7355219b-be7d-4f06-8966-119ab9535a74" (UID: "7355219b-be7d-4f06-8966-119ab9535a74"). InnerVolumeSpecName "kube-api-access-z67nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:48:45.251002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.250907    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec18b8e0-9578-4463-9828-a5363688e686-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:45.251002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.250941    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7355219b-be7d-4f06-8966-119ab9535a74-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:45.251002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.250953    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9wkc\" (UniqueName: \"kubernetes.io/projected/ec18b8e0-9578-4463-9828-a5363688e686-kube-api-access-p9wkc\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:45.251002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.250962    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z67nc\" (UniqueName: \"kubernetes.io/projected/7355219b-be7d-4f06-8966-119ab9535a74-kube-api-access-z67nc\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:45.334955 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.334921    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:45.432235 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.432178    2563 generic.go:356] "Generic (PLEG): container finished" podID="ec18b8e0-9578-4463-9828-a5363688e686" containerID="c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a" exitCode=0
Jul 29 18:48:45.432235 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.432234    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"
Jul 29 18:48:45.432484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.432265    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" event={"ID":"ec18b8e0-9578-4463-9828-a5363688e686","Type":"ContainerDied","Data":"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"}
Jul 29 18:48:45.432484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.432320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w" event={"ID":"ec18b8e0-9578-4463-9828-a5363688e686","Type":"ContainerDied","Data":"557b7fa58fa62623f876abffbf0b65a7791c7da6850eefc6cfb3ec7ad26ed16f"}
Jul 29 18:48:45.432484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.432343    2563 scope.go:117] "RemoveContainer" containerID="c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"
Jul 29 18:48:45.433718 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.433689    2563 generic.go:356] "Generic (PLEG): container finished" podID="7355219b-be7d-4f06-8966-119ab9535a74" containerID="56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2" exitCode=0
Jul 29 18:48:45.433817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.433740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" event={"ID":"7355219b-be7d-4f06-8966-119ab9535a74","Type":"ContainerDied","Data":"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"}
Jul 29 18:48:45.433817 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.433809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62" event={"ID":"7355219b-be7d-4f06-8966-119ab9535a74","Type":"ContainerDied","Data":"62fd8dddc497b21e8bb3bc9e2cd7139d1dcf7fe9a2c9938c365ff9d297c6c24c"}
Jul 29 18:48:45.433936 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.433749    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"
Jul 29 18:48:45.442359 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.442340    2563 scope.go:117] "RemoveContainer" containerID="c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"
Jul 29 18:48:45.442720 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:48:45.442691    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a\": container with ID starting with c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a not found: ID does not exist" containerID="c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"
Jul 29 18:48:45.442820 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.442731    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a"} err="failed to get container status \"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a\": rpc error: code = NotFound desc = could not find container \"c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a\": container with ID starting with c840cea2d2d4c28df24c32235d274fc7af89d48e4f4f65dc74a5b161cf20b74a not found: ID does not exist"
Jul 29 18:48:45.442820 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.442755    2563 scope.go:117] "RemoveContainer" containerID="56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"
Jul 29 18:48:45.451503 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.451479    2563 scope.go:117] "RemoveContainer" containerID="56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"
Jul 29 18:48:45.451832 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:48:45.451809    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2\": container with ID starting with 56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2 not found: ID does not exist" containerID="56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"
Jul 29 18:48:45.451889 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.451842    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2"} err="failed to get container status \"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2\": rpc error: code = NotFound desc = could not find container \"56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2\": container with ID starting with 56b268163bd5d962c205cb13017db5136e786370f2cc9dbce72a98b1c40a81f2 not found: ID does not exist"
Jul 29 18:48:45.456274 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.456246    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:45.461030 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.461004    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-8b8f04-565df97968-z8f5w"]
Jul 29 18:48:45.472082 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.472046    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:45.477844 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.477819    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-8b8f04-d4bd9b54d-xjg62"]
Jul 29 18:48:45.587038 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.586964    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46ebc788-83d1-420a-ba85-28b9b435f407" path="/var/lib/kubelet/pods/46ebc788-83d1-420a-ba85-28b9b435f407/volumes"
Jul 29 18:48:45.587366 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.587352    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7355219b-be7d-4f06-8966-119ab9535a74" path="/var/lib/kubelet/pods/7355219b-be7d-4f06-8966-119ab9535a74/volumes"
Jul 29 18:48:45.587708 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:45.587684    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec18b8e0-9578-4463-9828-a5363688e686" path="/var/lib/kubelet/pods/ec18b8e0-9578-4463-9828-a5363688e686/volumes"
Jul 29 18:48:51.015211 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:51.015168    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:51.084627 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:51.084592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:51.229924 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:51.229895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:51.294559 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:51.294467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:51.496506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:51.496476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:48:54.731960 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.731923    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"]
Jul 29 18:48:54.732397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732372    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec18b8e0-9578-4463-9828-a5363688e686" containerName="payload-pre-processing"
Jul 29 18:48:54.732397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732384    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec18b8e0-9578-4463-9828-a5363688e686" containerName="payload-pre-processing"
Jul 29 18:48:54.732397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732398    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7355219b-be7d-4f06-8966-119ab9535a74" containerName="payload-processing"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732404    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7355219b-be7d-4f06-8966-119ab9535a74" containerName="payload-processing"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732417    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46ebc788-83d1-420a-ba85-28b9b435f407" containerName="revoke-keys"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732422    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="46ebc788-83d1-420a-ba85-28b9b435f407" containerName="revoke-keys"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732492    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7355219b-be7d-4f06-8966-119ab9535a74" containerName="payload-processing"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732499    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="46ebc788-83d1-420a-ba85-28b9b435f407" containerName="revoke-keys"
Jul 29 18:48:54.732515 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.732505    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec18b8e0-9578-4463-9828-a5363688e686" containerName="payload-pre-processing"
Jul 29 18:48:54.737256 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.737227    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:54.738893 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.738783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt\" (UID: \"a5703724-d748-4cfb-9114-10da39017ad2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:54.740158 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.740132    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:48:54.740325 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.740136    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:48:54.742581 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.742554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"]
Jul 29 18:48:54.839590 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.839551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt\" (UID: \"a5703724-d748-4cfb-9114-10da39017ad2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:54.840261 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:54.840232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt\" (UID: \"a5703724-d748-4cfb-9114-10da39017ad2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:55.051534 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:55.051425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:55.405747 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:55.405711    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"]
Jul 29 18:48:55.408931 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:48:55.408903    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5703724_d748_4cfb_9114_10da39017ad2.slice/crio-721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494 WatchSource:0}: Error finding container 721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494: Status 404 returned error can't find the container with id 721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494
Jul 29 18:48:55.500230 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:55.500186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt" event={"ID":"a5703724-d748-4cfb-9114-10da39017ad2","Type":"ContainerStarted","Data":"721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494"}
Jul 29 18:48:56.507858 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:56.507760    2563 generic.go:356] "Generic (PLEG): container finished" podID="a5703724-d748-4cfb-9114-10da39017ad2" containerID="86c5a89fddfca00fb7a981519971d6d82271d1be707c1689ba16cb326344296d" exitCode=0
Jul 29 18:48:56.508253 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:56.507852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt" event={"ID":"a5703724-d748-4cfb-9114-10da39017ad2","Type":"ContainerDied","Data":"86c5a89fddfca00fb7a981519971d6d82271d1be707c1689ba16cb326344296d"}
Jul 29 18:48:57.663383 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:57.663355    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:57.767894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:57.767804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca\") pod \"a5703724-d748-4cfb-9114-10da39017ad2\" (UID: \"a5703724-d748-4cfb-9114-10da39017ad2\") "
Jul 29 18:48:57.768233 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:57.768184    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a5703724-d748-4cfb-9114-10da39017ad2" (UID: "a5703724-d748-4cfb-9114-10da39017ad2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:48:57.869133 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:57.869101    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a5703724-d748-4cfb-9114-10da39017ad2-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:48:58.521853 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:58.521820    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"
Jul 29 18:48:58.522017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:58.521853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt" event={"ID":"a5703724-d748-4cfb-9114-10da39017ad2","Type":"ContainerDied","Data":"721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494"}
Jul 29 18:48:58.522017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:48:58.521911    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="721890220ed921794d49b33bac5fb36f924f526c35a0283ee191fa3086b5a494"
Jul 29 18:49:10.200484 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.200431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:10.227275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.227230    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:49:10.227546 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.227519    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" podUID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" containerName="payload-processing" containerID="cri-o://92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627" gracePeriod=30
Jul 29 18:49:10.236506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.236128    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:49:10.236506 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.236401    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" podUID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" containerName="payload-pre-processing" containerID="cri-o://5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e" gracePeriod=30
Jul 29 18:49:10.269620 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.269584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:10.329939 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.329909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:10.362144 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.362019    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"]
Jul 29 18:49:10.365453 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.365417    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-479e5c-fz4kt"]
Jul 29 18:49:10.432123 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.432088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:10.547825 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.547799    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:49:10.552501 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.552474    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:49:10.589424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.589386    2563 generic.go:356] "Generic (PLEG): container finished" podID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" containerID="92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627" exitCode=0
Jul 29 18:49:10.589424 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.589431    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"
Jul 29 18:49:10.589688 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.589472    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" event={"ID":"cf46e1e2-195a-4da6-b1ae-d84d2e48b309","Type":"ContainerDied","Data":"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"}
Jul 29 18:49:10.589688 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.589550    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448" event={"ID":"cf46e1e2-195a-4da6-b1ae-d84d2e48b309","Type":"ContainerDied","Data":"18a91a1684983e504c6a7b6e9d687562ec00c3a56062808e4560cfdf54c171c3"}
Jul 29 18:49:10.589688 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.589598    2563 scope.go:117] "RemoveContainer" containerID="92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"
Jul 29 18:49:10.590070 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.590042    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6hv9\" (UniqueName: \"kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9\") pod \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") "
Jul 29 18:49:10.590245 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.590105    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrm4w\" (UniqueName: \"kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w\") pod \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") "
Jul 29 18:49:10.590245 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.590175    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume\") pod \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\" (UID: \"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a\") "
Jul 29 18:49:10.590245 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.590240    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume\") pod \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\" (UID: \"cf46e1e2-195a-4da6-b1ae-d84d2e48b309\") "
Jul 29 18:49:10.591028 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.590912    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf46e1e2-195a-4da6-b1ae-d84d2e48b309" (UID: "cf46e1e2-195a-4da6-b1ae-d84d2e48b309"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:49:10.591981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.591398    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" (UID: "ded614b3-8e47-4c1f-ab3d-2b85e4544e8a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:49:10.591981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.591760    2563 generic.go:356] "Generic (PLEG): container finished" podID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" containerID="5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e" exitCode=0
Jul 29 18:49:10.591981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.591885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" event={"ID":"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a","Type":"ContainerDied","Data":"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"}
Jul 29 18:49:10.591981 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.591931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755" event={"ID":"ded614b3-8e47-4c1f-ab3d-2b85e4544e8a","Type":"ContainerDied","Data":"11cc69b9e9e8080d64678db988a8d5b760f9de88c63669f8f84afdeb544a69dc"}
Jul 29 18:49:10.592344 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.592003    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"
Jul 29 18:49:10.592892 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.592869    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9" (OuterVolumeSpecName: "kube-api-access-l6hv9") pod "ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" (UID: "ded614b3-8e47-4c1f-ab3d-2b85e4544e8a"). InnerVolumeSpecName "kube-api-access-l6hv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:49:10.593357 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.593323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w" (OuterVolumeSpecName: "kube-api-access-jrm4w") pod "cf46e1e2-195a-4da6-b1ae-d84d2e48b309" (UID: "cf46e1e2-195a-4da6-b1ae-d84d2e48b309"). InnerVolumeSpecName "kube-api-access-jrm4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:49:10.600536 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.600507    2563 scope.go:117] "RemoveContainer" containerID="92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"
Jul 29 18:49:10.600931 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:49:10.600908    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627\": container with ID starting with 92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627 not found: ID does not exist" containerID="92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"
Jul 29 18:49:10.601024 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.600943    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627"} err="failed to get container status \"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627\": rpc error: code = NotFound desc = could not find container \"92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627\": container with ID starting with 92d936c939bb6b543df2911863def9b2811886f18c6f3253a3730650ae962627 not found: ID does not exist"
Jul 29 18:49:10.601024 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.600968    2563 scope.go:117] "RemoveContainer" containerID="5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"
Jul 29 18:49:10.611430 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.611394    2563 scope.go:117] "RemoveContainer" containerID="5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"
Jul 29 18:49:10.611828 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:49:10.611793    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e\": container with ID starting with 5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e not found: ID does not exist" containerID="5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"
Jul 29 18:49:10.611936 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.611825    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e"} err="failed to get container status \"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e\": rpc error: code = NotFound desc = could not find container \"5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e\": container with ID starting with 5e0d6fa1a3609bcc15f407e7023810500b71720f0bc6751f8fd42062cd5b1e6e not found: ID does not exist"
Jul 29 18:49:10.691168 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.691126    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrm4w\" (UniqueName: \"kubernetes.io/projected/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-kube-api-access-jrm4w\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:49:10.691168 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.691159    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:49:10.691168 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.691169    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf46e1e2-195a-4da6-b1ae-d84d2e48b309-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:49:10.691455 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.691182    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6hv9\" (UniqueName: \"kubernetes.io/projected/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a-kube-api-access-l6hv9\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:49:10.732653 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.732570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:10.918168 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.918116    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:49:10.921532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.921502    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-479e5c-7f5bbdc664-kh448"]
Jul 29 18:49:10.932324 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.932292    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:49:10.934217 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:10.934185    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-479e5c-75df99fd44-9f755"]
Jul 29 18:49:11.587251 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:11.587149    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5703724-d748-4cfb-9114-10da39017ad2" path="/var/lib/kubelet/pods/a5703724-d748-4cfb-9114-10da39017ad2/volumes"
Jul 29 18:49:11.587624 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:11.587554    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" path="/var/lib/kubelet/pods/cf46e1e2-195a-4da6-b1ae-d84d2e48b309/volumes"
Jul 29 18:49:11.587871 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:11.587854    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" path="/var/lib/kubelet/pods/ded614b3-8e47-4c1f-ab3d-2b85e4544e8a/volumes"
Jul 29 18:49:15.770798 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:15.770758    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:46.410532 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:46.410470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:46.630953 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:46.630916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:52.614508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:52.614473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:52.718120 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:52.718018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:56.079467 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:56.079439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:56.129133 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:56.129098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:58.380047 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:58.380013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:58.482510 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:58.482474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:58.658630 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:58.658544    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:58.924574 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:58.924481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:49:59.047021 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.046985    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"]
Jul 29 18:49:59.047446 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047433    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" containerName="payload-pre-processing"
Jul 29 18:49:59.047509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047448    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" containerName="payload-pre-processing"
Jul 29 18:49:59.047509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047459    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5703724-d748-4cfb-9114-10da39017ad2" containerName="revoke-keys"
Jul 29 18:49:59.047509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047465    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5703724-d748-4cfb-9114-10da39017ad2" containerName="revoke-keys"
Jul 29 18:49:59.047509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047480    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" containerName="payload-processing"
Jul 29 18:49:59.047509 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047486    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" containerName="payload-processing"
Jul 29 18:49:59.047684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047546    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5703724-d748-4cfb-9114-10da39017ad2" containerName="revoke-keys"
Jul 29 18:49:59.047684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047556    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf46e1e2-195a-4da6-b1ae-d84d2e48b309" containerName="payload-processing"
Jul 29 18:49:59.047684 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.047563    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded614b3-8e47-4c1f-ab3d-2b85e4544e8a" containerName="payload-pre-processing"
Jul 29 18:49:59.052017 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.052001    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:49:59.055105 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.055081    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:49:59.056319 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.056294    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:49:59.059567 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.059539    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"]
Jul 29 18:49:59.113960 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.113920    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr\" (UID: \"67193173-28be-4f37-874c-c71850e3f07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:49:59.215178 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.215086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr\" (UID: \"67193173-28be-4f37-874c-c71850e3f07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:49:59.215781 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.215761    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr\" (UID: \"67193173-28be-4f37-874c-c71850e3f07b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:49:59.365372 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.365310    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:49:59.515925 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.515895    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"]
Jul 29 18:49:59.517947 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:49:59.517923    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67193173_28be_4f37_874c_c71850e3f07b.slice/crio-e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4 WatchSource:0}: Error finding container e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4: Status 404 returned error can't find the container with id e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4
Jul 29 18:49:59.859152 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.859115    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr" event={"ID":"67193173-28be-4f37-874c-c71850e3f07b","Type":"ContainerStarted","Data":"71f832ade36e0352ce24e924aa589611ce0efef9d1684d457540a2442d4691ad"}
Jul 29 18:49:59.859393 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.859185    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr" event={"ID":"67193173-28be-4f37-874c-c71850e3f07b","Type":"ContainerStarted","Data":"e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4"}
Jul 29 18:49:59.876949 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:49:59.876898    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr" podStartSLOduration=0.876879975 podStartE2EDuration="876.879975ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:49:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:49:59.874515483 +0000 UTC m=+3422.847557664" watchObservedRunningTime="2026-07-29 18:49:59.876879975 +0000 UTC m=+3422.849922155"
Jul 29 18:50:00.867212 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:00.867149    2563 generic.go:356] "Generic (PLEG): container finished" podID="67193173-28be-4f37-874c-c71850e3f07b" containerID="71f832ade36e0352ce24e924aa589611ce0efef9d1684d457540a2442d4691ad" exitCode=0
Jul 29 18:50:00.867626 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:00.867238    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr" event={"ID":"67193173-28be-4f37-874c-c71850e3f07b","Type":"ContainerDied","Data":"71f832ade36e0352ce24e924aa589611ce0efef9d1684d457540a2442d4691ad"}
Jul 29 18:50:02.021759 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.021711    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:50:02.144512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.144423    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca\") pod \"67193173-28be-4f37-874c-c71850e3f07b\" (UID: \"67193173-28be-4f37-874c-c71850e3f07b\") "
Jul 29 18:50:02.144821 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.144793    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67193173-28be-4f37-874c-c71850e3f07b" (UID: "67193173-28be-4f37-874c-c71850e3f07b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:02.245917 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.245876    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67193173-28be-4f37-874c-c71850e3f07b-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:02.880862 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.880834    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"
Jul 29 18:50:02.881048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.880875    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr" event={"ID":"67193173-28be-4f37-874c-c71850e3f07b","Type":"ContainerDied","Data":"e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4"}
Jul 29 18:50:02.881048 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:02.880917    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e13f181a1df346639cfe70cd8ebe10313e9a4aa695aa210940c9b545382437c4"
Jul 29 18:50:09.575206 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.575157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:09.604474 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.604433    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:50:09.604763 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.604715    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerName="payload-processing" containerID="cri-o://a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b" gracePeriod=30
Jul 29 18:50:09.611959 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.611923    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:50:09.612400 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.612238    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerName="payload-pre-processing" containerID="cri-o://1fa99a9168482c4f88293a7a6fd2a4990dcc73d4cf1d15f404a3fe7ce19b5da0" gracePeriod=30
Jul 29 18:50:09.731947 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.731914    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"]
Jul 29 18:50:09.734022 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.733979    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-b0fdf2-fv6gr"]
Jul 29 18:50:09.785837 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.785630    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.79:9004: connect: connection refused"
Jul 29 18:50:09.863728 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.863691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:09.896125 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.896096    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:50:09.922703 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.922667    2563 generic.go:356] "Generic (PLEG): container finished" podID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerID="a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b" exitCode=0
Jul 29 18:50:09.922887 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.922698    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" event={"ID":"b04a9607-11c9-4091-93fd-0fc10766dc44","Type":"ContainerDied","Data":"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"}
Jul 29 18:50:09.922887 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.922718    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"
Jul 29 18:50:09.922887 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.922764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" event={"ID":"b04a9607-11c9-4091-93fd-0fc10766dc44","Type":"ContainerDied","Data":"54ac0a03dbfab0b2a9ff6610132ae32e0fa0ecbcb2a87c0f1d43d5a1992df9a7"}
Jul 29 18:50:09.922887 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.922784    2563 scope.go:117] "RemoveContainer" containerID="a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"
Jul 29 18:50:09.924781 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.924754    2563 generic.go:356] "Generic (PLEG): container finished" podID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerID="1fa99a9168482c4f88293a7a6fd2a4990dcc73d4cf1d15f404a3fe7ce19b5da0" exitCode=0
Jul 29 18:50:09.924896 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.924837    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" event={"ID":"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7","Type":"ContainerDied","Data":"1fa99a9168482c4f88293a7a6fd2a4990dcc73d4cf1d15f404a3fe7ce19b5da0"}
Jul 29 18:50:09.924944 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.924904    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj" event={"ID":"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7","Type":"ContainerDied","Data":"2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b"}
Jul 29 18:50:09.924944 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.924933    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2739330fbf83a125fcc1b869a293f98bdf75b01851ef4c2b4fa50359455dd16b"
Jul 29 18:50:09.926766 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.926751    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:50:09.932438 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.932314    2563 scope.go:117] "RemoveContainer" containerID="a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"
Jul 29 18:50:09.932675 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:09.932653    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b\": container with ID starting with a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b not found: ID does not exist" containerID="a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"
Jul 29 18:50:09.932750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.932687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:09.932750 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:09.932689    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b"} err="failed to get container status \"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b\": rpc error: code = NotFound desc = could not find container \"a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b\": container with ID starting with a17bd183472cc45829c4a6693140cd38de7de44befd3021a668888120a56f32b not found: ID does not exist"
Jul 29 18:50:10.018148 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018110    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-746nm\" (UniqueName: \"kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm\") pod \"b04a9607-11c9-4091-93fd-0fc10766dc44\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") "
Jul 29 18:50:10.018392 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018262    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjd8h\" (UniqueName: \"kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h\") pod \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") "
Jul 29 18:50:10.018392 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018290    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume\") pod \"b04a9607-11c9-4091-93fd-0fc10766dc44\" (UID: \"b04a9607-11c9-4091-93fd-0fc10766dc44\") "
Jul 29 18:50:10.018392 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018322    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume\") pod \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\" (UID: \"64aafc34-7cf7-4f0c-b5e2-7d6f280767b7\") "
Jul 29 18:50:10.018716 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b04a9607-11c9-4091-93fd-0fc10766dc44" (UID: "b04a9607-11c9-4091-93fd-0fc10766dc44"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:10.018716 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.018687    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" (UID: "64aafc34-7cf7-4f0c-b5e2-7d6f280767b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:10.020433 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.020411    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm" (OuterVolumeSpecName: "kube-api-access-746nm") pod "b04a9607-11c9-4091-93fd-0fc10766dc44" (UID: "b04a9607-11c9-4091-93fd-0fc10766dc44"). InnerVolumeSpecName "kube-api-access-746nm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:10.020508 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.020480    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h" (OuterVolumeSpecName: "kube-api-access-vjd8h") pod "64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" (UID: "64aafc34-7cf7-4f0c-b5e2-7d6f280767b7"). InnerVolumeSpecName "kube-api-access-vjd8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:10.110094 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.110049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:10.119416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.119388    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-746nm\" (UniqueName: \"kubernetes.io/projected/b04a9607-11c9-4091-93fd-0fc10766dc44-kube-api-access-746nm\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:10.119416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.119417    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjd8h\" (UniqueName: \"kubernetes.io/projected/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-kube-api-access-vjd8h\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:10.119593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.119426    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b04a9607-11c9-4091-93fd-0fc10766dc44-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:10.119593 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.119437    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:10.244956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.244915    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:50:10.248142 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.248112    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d"]
Jul 29 18:50:10.784979 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.784935    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-b-b0fdf2-77fcb55bd8-pjp9d" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.80:9004: i/o timeout"
Jul 29 18:50:10.931512 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.931429    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"
Jul 29 18:50:10.953521 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.953480    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:50:10.957096 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:10.957054    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-b0fdf2-5b77ccff64-cnfxj"]
Jul 29 18:50:11.586210 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:11.586169    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" path="/var/lib/kubelet/pods/64aafc34-7cf7-4f0c-b5e2-7d6f280767b7/volumes"
Jul 29 18:50:11.586521 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:11.586507    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67193173-28be-4f37-874c-c71850e3f07b" path="/var/lib/kubelet/pods/67193173-28be-4f37-874c-c71850e3f07b/volumes"
Jul 29 18:50:11.586815 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:11.586804    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" path="/var/lib/kubelet/pods/b04a9607-11c9-4091-93fd-0fc10766dc44/volumes"
Jul 29 18:50:15.873723 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:15.873689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:15.931894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:15.931861    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:16.223118 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:16.223025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:16.488884 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:16.488782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.186078 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.186043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.186759 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.186733    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"]
Jul 29 18:50:27.189489 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.189459    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-297c4d-29755845-d5kgh"]
Jul 29 18:50:27.217667 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.217624    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:50:27.217982 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.217925    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" podUID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" containerName="payload-processing" containerID="cri-o://607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52" gracePeriod=30
Jul 29 18:50:27.226360 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.226326    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:50:27.227064 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.226570    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" podUID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" containerName="payload-pre-processing" containerID="cri-o://d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65" gracePeriod=30
Jul 29 18:50:27.258853 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.258813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.320567 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.320531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.378456 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.378400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.506948 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.506923    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:50:27.535373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.535346    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:50:27.587183 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.587151    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f505b8-a05d-4f3c-80d6-508e39cb2e47" path="/var/lib/kubelet/pods/b1f505b8-a05d-4f3c-80d6-508e39cb2e47/volumes"
Jul 29 18:50:27.588802 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.588785    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz7gn\" (UniqueName: \"kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn\") pod \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") "
Jul 29 18:50:27.588869 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.588819    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume\") pod \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\" (UID: \"af58af3d-61b8-4634-b8a1-b49b0031a7f1\") "
Jul 29 18:50:27.589239 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.589212    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "af58af3d-61b8-4634-b8a1-b49b0031a7f1" (UID: "af58af3d-61b8-4634-b8a1-b49b0031a7f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:27.590805 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.590786    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn" (OuterVolumeSpecName: "kube-api-access-cz7gn") pod "af58af3d-61b8-4634-b8a1-b49b0031a7f1" (UID: "af58af3d-61b8-4634-b8a1-b49b0031a7f1"). InnerVolumeSpecName "kube-api-access-cz7gn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:27.690148 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.690117    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume\") pod \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") "
Jul 29 18:50:27.690346 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.690159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-km6xf\" (UniqueName: \"kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf\") pod \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\" (UID: \"e5c72dd9-9946-4887-b75f-6c2f9050aa48\") "
Jul 29 18:50:27.690425 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.690412    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz7gn\" (UniqueName: \"kubernetes.io/projected/af58af3d-61b8-4634-b8a1-b49b0031a7f1-kube-api-access-cz7gn\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:27.690491 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.690426    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/af58af3d-61b8-4634-b8a1-b49b0031a7f1-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:27.690557 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.690535    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e5c72dd9-9946-4887-b75f-6c2f9050aa48" (UID: "e5c72dd9-9946-4887-b75f-6c2f9050aa48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:27.692309 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.692286    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf" (OuterVolumeSpecName: "kube-api-access-km6xf") pod "e5c72dd9-9946-4887-b75f-6c2f9050aa48" (UID: "e5c72dd9-9946-4887-b75f-6c2f9050aa48"). InnerVolumeSpecName "kube-api-access-km6xf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:27.764703 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.764624    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:27.791426 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.791393    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-km6xf\" (UniqueName: \"kubernetes.io/projected/e5c72dd9-9946-4887-b75f-6c2f9050aa48-kube-api-access-km6xf\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:27.791426 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:27.791423    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e5c72dd9-9946-4887-b75f-6c2f9050aa48-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:28.026335 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.026244    2563 generic.go:356] "Generic (PLEG): container finished" podID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" containerID="607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52" exitCode=0
Jul 29 18:50:28.026335 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.026286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"
Jul 29 18:50:28.026549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.026330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" event={"ID":"af58af3d-61b8-4634-b8a1-b49b0031a7f1","Type":"ContainerDied","Data":"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"}
Jul 29 18:50:28.026549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.026387    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf" event={"ID":"af58af3d-61b8-4634-b8a1-b49b0031a7f1","Type":"ContainerDied","Data":"f0864e523219aecf46f387770c3ed28045e90f91a16aa62262d2f05df2f27b6b"}
Jul 29 18:50:28.026549 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.026418    2563 scope.go:117] "RemoveContainer" containerID="607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"
Jul 29 18:50:28.027739 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.027719    2563 generic.go:356] "Generic (PLEG): container finished" podID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" containerID="d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65" exitCode=0
Jul 29 18:50:28.027872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.027762    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"
Jul 29 18:50:28.027872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.027796    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" event={"ID":"e5c72dd9-9946-4887-b75f-6c2f9050aa48","Type":"ContainerDied","Data":"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"}
Jul 29 18:50:28.027872 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.027849    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58" event={"ID":"e5c72dd9-9946-4887-b75f-6c2f9050aa48","Type":"ContainerDied","Data":"0cba30c831c3f98974788ff3b0ab66eeb3f7a779d41d9649ec8f16079240aeb1"}
Jul 29 18:50:28.036598 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.036563    2563 scope.go:117] "RemoveContainer" containerID="607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"
Jul 29 18:50:28.036916 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:28.036897    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52\": container with ID starting with 607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52 not found: ID does not exist" containerID="607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"
Jul 29 18:50:28.036982 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.036926    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52"} err="failed to get container status \"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52\": rpc error: code = NotFound desc = could not find container \"607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52\": container with ID starting with 607005aea1d4eed9bc00610f216c4edab99c74236edf22a47d014c91a5761d52 not found: ID does not exist"
Jul 29 18:50:28.036982 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.036944    2563 scope.go:117] "RemoveContainer" containerID="d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"
Jul 29 18:50:28.045643 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.045625    2563 scope.go:117] "RemoveContainer" containerID="d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"
Jul 29 18:50:28.045908 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:28.045890    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65\": container with ID starting with d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65 not found: ID does not exist" containerID="d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"
Jul 29 18:50:28.045954 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.045918    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65"} err="failed to get container status \"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65\": rpc error: code = NotFound desc = could not find container \"d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65\": container with ID starting with d992cc96356f3dfc7615d1e3cabcbf33c1891109d8b5b516ecc6e7e600046d65 not found: ID does not exist"
Jul 29 18:50:28.051564 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.051534    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:50:28.055097 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.055074    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-297c4d-7d76dcbd9d-69bpf"]
Jul 29 18:50:28.066864 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.066834    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:50:28.071778 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:28.071746    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-297c4d-6f59b97668-s9h58"]
Jul 29 18:50:29.587749 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:29.587719    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" path="/var/lib/kubelet/pods/af58af3d-61b8-4634-b8a1-b49b0031a7f1/volumes"
Jul 29 18:50:29.588135 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:29.588091    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" path="/var/lib/kubelet/pods/e5c72dd9-9946-4887-b75f-6c2f9050aa48/volumes"
Jul 29 18:50:33.615618 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:33.615587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:33.695139 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:33.695107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:33.886626 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:33.886549    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:34.131342 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.131308    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:34.246153 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246077    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"]
Jul 29 18:50:34.246480 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246467    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" containerName="payload-processing"
Jul 29 18:50:34.246523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246481    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" containerName="payload-processing"
Jul 29 18:50:34.246523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246493    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerName="payload-pre-processing"
Jul 29 18:50:34.246523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246499    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerName="payload-pre-processing"
Jul 29 18:50:34.246523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246505    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerName="payload-processing"
Jul 29 18:50:34.246523 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246510    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerName="payload-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246526    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67193173-28be-4f37-874c-c71850e3f07b" containerName="revoke-keys"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246531    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="67193173-28be-4f37-874c-c71850e3f07b" containerName="revoke-keys"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246537    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" containerName="payload-pre-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246542    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" containerName="payload-pre-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246600    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="67193173-28be-4f37-874c-c71850e3f07b" containerName="revoke-keys"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246608    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b04a9607-11c9-4091-93fd-0fc10766dc44" containerName="payload-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246616    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5c72dd9-9946-4887-b75f-6c2f9050aa48" containerName="payload-pre-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246622    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="af58af3d-61b8-4634-b8a1-b49b0031a7f1" containerName="payload-processing"
Jul 29 18:50:34.246679 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.246627    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="64aafc34-7cf7-4f0c-b5e2-7d6f280767b7" containerName="payload-pre-processing"
Jul 29 18:50:34.251126 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.251107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:34.253946 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.253924    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 18:50:34.254068 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.253957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-d5mcn\""
Jul 29 18:50:34.257749 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.257720    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"]
Jul 29 18:50:34.353976 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.353936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm\" (UID: \"5b81e4b0-a2af-4c4d-b490-c1d479329cee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:34.455161 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.455117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm\" (UID: \"5b81e4b0-a2af-4c4d-b490-c1d479329cee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:34.455786 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.455768    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm\" (UID: \"5b81e4b0-a2af-4c4d-b490-c1d479329cee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:34.565050 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.564953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:34.706874 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:34.706840    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"]
Jul 29 18:50:34.710788 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:50:34.710747    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b81e4b0_a2af_4c4d_b490_c1d479329cee.slice/crio-40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595 WatchSource:0}: Error finding container 40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595: Status 404 returned error can't find the container with id 40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595
Jul 29 18:50:35.074580 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:35.074545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm" event={"ID":"5b81e4b0-a2af-4c4d-b490-c1d479329cee","Type":"ContainerStarted","Data":"9794afa4062d18ff3da617c031eca26de02fc70d14a871310aee25de9dbbe593"}
Jul 29 18:50:35.074752 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:35.074598    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm" event={"ID":"5b81e4b0-a2af-4c4d-b490-c1d479329cee","Type":"ContainerStarted","Data":"40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595"}
Jul 29 18:50:35.091415 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:35.091353    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm" podStartSLOduration=1.091329793 podStartE2EDuration="1.091329793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 18:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:50:35.088920269 +0000 UTC m=+3458.061962447" watchObservedRunningTime="2026-07-29 18:50:35.091329793 +0000 UTC m=+3458.064371968"
Jul 29 18:50:36.084663 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:36.084632    2563 generic.go:356] "Generic (PLEG): container finished" podID="5b81e4b0-a2af-4c4d-b490-c1d479329cee" containerID="9794afa4062d18ff3da617c031eca26de02fc70d14a871310aee25de9dbbe593" exitCode=0
Jul 29 18:50:36.085056 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:36.084714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm" event={"ID":"5b81e4b0-a2af-4c4d-b490-c1d479329cee","Type":"ContainerDied","Data":"9794afa4062d18ff3da617c031eca26de02fc70d14a871310aee25de9dbbe593"}
Jul 29 18:50:37.234905 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:37.234873    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:37.382696 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:37.382658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca\") pod \"5b81e4b0-a2af-4c4d-b490-c1d479329cee\" (UID: \"5b81e4b0-a2af-4c4d-b490-c1d479329cee\") "
Jul 29 18:50:37.383036 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:37.383010    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b81e4b0-a2af-4c4d-b490-c1d479329cee" (UID: "5b81e4b0-a2af-4c4d-b490-c1d479329cee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:37.484181 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:37.484147    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b81e4b0-a2af-4c4d-b490-c1d479329cee-maas-api-service-ca\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:38.095775 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:38.095747    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"
Jul 29 18:50:38.095775 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:38.095763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm" event={"ID":"5b81e4b0-a2af-4c4d-b490-c1d479329cee","Type":"ContainerDied","Data":"40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595"}
Jul 29 18:50:38.095996 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:38.095806    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40673c31ba30dc3ac6b09617ac5cba31fef69d3f16b9f8d8324ad46abcb28595"
Jul 29 18:50:44.678782 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.678750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:44.685186 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.685161    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"]
Jul 29 18:50:44.686779 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.686757    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-f9520e-29755845-jf847"]
Jul 29 18:50:44.720446 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.716603    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:50:44.720739 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.720707    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:50:44.721373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.720921    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" podUID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" containerName="payload-processing" containerID="cri-o://6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda" gracePeriod=30
Jul 29 18:50:44.721373 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.721130    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" podUID="4d62c363-a166-4020-b952-6eb18ddb0763" containerName="payload-pre-processing" containerID="cri-o://2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487" gracePeriod=30
Jul 29 18:50:44.742320 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:44.742287    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e2ac1_7615_4c7b_a15c_fc177027e3a7.slice/crio-6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 18:50:44.742468 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:44.742386    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9e2ac1_7615_4c7b_a15c_fc177027e3a7.slice/crio-6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda.scope\": RecentStats: unable to find data in memory cache]"
Jul 29 18:50:44.749483 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.749411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:44.811810 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.811760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:44.845262 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.845186    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"]
Jul 29 18:50:44.847465 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.847438    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f9520e-nf6pm"]
Jul 29 18:50:44.913294 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:44.913265    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:45.023488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.023443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:50:45.026366 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.026348    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:50:45.039973 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.039944    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbzth\" (UniqueName: \"kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth\") pod \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") "
Jul 29 18:50:45.042696 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.042665    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth" (OuterVolumeSpecName: "kube-api-access-hbzth") pod "7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" (UID: "7f9e2ac1-7615-4c7b-a15c-fc177027e3a7"). InnerVolumeSpecName "kube-api-access-hbzth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:45.133564 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.133528    2563 generic.go:356] "Generic (PLEG): container finished" podID="4d62c363-a166-4020-b952-6eb18ddb0763" containerID="2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487" exitCode=0
Jul 29 18:50:45.133747 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.133577    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"
Jul 29 18:50:45.133747 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.133625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" event={"ID":"4d62c363-a166-4020-b952-6eb18ddb0763","Type":"ContainerDied","Data":"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"}
Jul 29 18:50:45.133747 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.133675    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr" event={"ID":"4d62c363-a166-4020-b952-6eb18ddb0763","Type":"ContainerDied","Data":"64c946a37049b5d426b8a5f6f66f1048b10bd57b67871955102f71745c1b3515"}
Jul 29 18:50:45.133747 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.133697    2563 scope.go:117] "RemoveContainer" containerID="2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"
Jul 29 18:50:45.135137 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.135109    2563 generic.go:356] "Generic (PLEG): container finished" podID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" containerID="6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda" exitCode=0
Jul 29 18:50:45.135289 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.135150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" event={"ID":"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7","Type":"ContainerDied","Data":"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"}
Jul 29 18:50:45.135289 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.135157    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"
Jul 29 18:50:45.135289 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.135186    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d" event={"ID":"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7","Type":"ContainerDied","Data":"ac950fa1838a120c9a095636e1225022ec0648dff44f2d95430495a20241989c"}
Jul 29 18:50:45.140514 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140491    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume\") pod \"4d62c363-a166-4020-b952-6eb18ddb0763\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") "
Jul 29 18:50:45.140676 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140533    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume\") pod \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\" (UID: \"7f9e2ac1-7615-4c7b-a15c-fc177027e3a7\") "
Jul 29 18:50:45.140676 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140561    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7crz8\" (UniqueName: \"kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8\") pod \"4d62c363-a166-4020-b952-6eb18ddb0763\" (UID: \"4d62c363-a166-4020-b952-6eb18ddb0763\") "
Jul 29 18:50:45.140847 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140831    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbzth\" (UniqueName: \"kubernetes.io/projected/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-kube-api-access-hbzth\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:45.140847 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140839    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4d62c363-a166-4020-b952-6eb18ddb0763" (UID: "4d62c363-a166-4020-b952-6eb18ddb0763"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:45.140956 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.140929    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" (UID: "7f9e2ac1-7615-4c7b-a15c-fc177027e3a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 18:50:45.142678 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.142653    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8" (OuterVolumeSpecName: "kube-api-access-7crz8") pod "4d62c363-a166-4020-b952-6eb18ddb0763" (UID: "4d62c363-a166-4020-b952-6eb18ddb0763"). InnerVolumeSpecName "kube-api-access-7crz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 18:50:45.142979 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.142957    2563 scope.go:117] "RemoveContainer" containerID="2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"
Jul 29 18:50:45.143324 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:45.143305    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487\": container with ID starting with 2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487 not found: ID does not exist" containerID="2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"
Jul 29 18:50:45.143443 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.143343    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487"} err="failed to get container status \"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487\": rpc error: code = NotFound desc = could not find container \"2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487\": container with ID starting with 2a2f9587514698ca8b6ddb5c13498d184d96b4919457701c4f8e2a43757d8487 not found: ID does not exist"
Jul 29 18:50:45.143443 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.143368    2563 scope.go:117] "RemoveContainer" containerID="6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"
Jul 29 18:50:45.151403 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.151368    2563 scope.go:117] "RemoveContainer" containerID="6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"
Jul 29 18:50:45.151701 ip-10-0-142-182 kubenswrapper[2563]: E0729 18:50:45.151676    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda\": container with ID starting with 6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda not found: ID does not exist" containerID="6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"
Jul 29 18:50:45.151768 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.151714    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda"} err="failed to get container status \"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda\": rpc error: code = NotFound desc = could not find container \"6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda\": container with ID starting with 6bf6c410e6f1b0812b01c1f61c6302fa4384c244596622def8c258a84b7a2bda not found: ID does not exist"
Jul 29 18:50:45.213774 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.213696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:45.241405 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.241372    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4d62c363-a166-4020-b952-6eb18ddb0763-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:45.241405 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.241402    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7-plugins-config-volume\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:45.241405 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.241413    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7crz8\" (UniqueName: \"kubernetes.io/projected/4d62c363-a166-4020-b952-6eb18ddb0763-kube-api-access-7crz8\") on node \"ip-10-0-142-182.ec2.internal\" DevicePath \"\""
Jul 29 18:50:45.459946 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.459908    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:50:45.463590 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.463550    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-f9520e-f446bc58d-sqwcr"]
Jul 29 18:50:45.475800 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.475713    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:50:45.479328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.479303    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-f9520e-7b4488f77d-dkz6d"]
Jul 29 18:50:45.586298 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.586257    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d62c363-a166-4020-b952-6eb18ddb0763" path="/var/lib/kubelet/pods/4d62c363-a166-4020-b952-6eb18ddb0763/volumes"
Jul 29 18:50:45.586718 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.586700    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b81e4b0-a2af-4c4d-b490-c1d479329cee" path="/var/lib/kubelet/pods/5b81e4b0-a2af-4c4d-b490-c1d479329cee/volumes"
Jul 29 18:50:45.587026 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.587013    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" path="/var/lib/kubelet/pods/7f9e2ac1-7615-4c7b-a15c-fc177027e3a7/volumes"
Jul 29 18:50:45.587273 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:45.587260    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a880cd0c-0228-425b-9f31-a44d8dce58cb" path="/var/lib/kubelet/pods/a880cd0c-0228-425b-9f31-a44d8dce58cb/volumes"
Jul 29 18:50:51.265248 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:51.265185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:51.368486 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:51.368441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:51.557002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:51.556895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:51.746699 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:51.746654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:50:57.257971 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:57.257935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q922c_8850ccc6-399f-442c-970f-bea3ea2ef73f/manager/0.log"
Jul 29 18:50:57.370567 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:57.370534    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k7xq8_25307baa-9c6e-49ae-b822-a1e6d416c099/manager/0.log"
Jul 29 18:50:57.608883 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:57.608854    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zxvtr_f2c0cd6e-dc53-4845-a3f5-088969f54bc0/server/0.log"
Jul 29 18:50:57.726843 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:57.726807    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-728md_91c1c5d7-b3ae-41c9-8ed2-068473a59e3d/manager/0.log"
Jul 29 18:50:58.073682 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:58.073600    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2_5d88c664-c56a-47e3-9617-eefc16b28b1d/copy-manifests/0.log"
Jul 29 18:50:58.086243 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:50:58.086189    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2_5d88c664-c56a-47e3-9617-eefc16b28b1d/manager/0.log"
Jul 29 18:51:00.671605 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:00.671573    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5d8hf_3718d92f-8de9-4ce7-92f5-f60db94a43cc/manager/0.log"
Jul 29 18:51:00.890273 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:00.890245    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wt788_643843c6-51b4-4a45-84c5-6368fa95a783/manager/0.log"
Jul 29 18:51:01.338612 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:01.338578    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-89ssf_56ede77f-1efa-485d-a724-050ca8cad2fe/discovery/0.log"
Jul 29 18:51:01.556208 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:01.556179    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786b455d9f-r7fk8_8bd0af73-ea1f-40e1-9320-b94e8f473651/kube-auth-proxy/0.log"
Jul 29 18:51:01.788121 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:01.788062    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kjs6n_3864dce7-cea7-4c15-8605-3ae4cef7292a/payload-pre-processing/0.log"
Jul 29 18:51:01.902113 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:01.902082    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:51:02.445275 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:02.445246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qxsj4_42a17083-f62b-4850-a776-87ca8152ee99/main/0.log"
Jul 29 18:51:02.764804 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:02.764722    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-p4g75_91139ff1-200e-4d92-a179-3e66e30c3670/main/0.log"
Jul 29 18:51:07.790368 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:07.790334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:51:07.867432 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:07.867399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:51:10.569002 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:10.568967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dtp7s_2dfe09fd-e275-4e17-9c9f-98a76e8f2936/global-pull-secret-syncer/0.log"
Jul 29 18:51:10.614894 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:10.614859    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log"
Jul 29 18:51:10.779772 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:10.779738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-182.ec2.internal_276e8303a183e235d090627747bbcd3f/haproxy/0.log"
Jul 29 18:51:16.746472 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:16.746432    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5d8hf_3718d92f-8de9-4ce7-92f5-f60db94a43cc/manager/0.log"
Jul 29 18:51:16.873457 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:16.873423    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-wt788_643843c6-51b4-4a45-84c5-6368fa95a783/manager/0.log"
Jul 29 18:51:18.734061 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:18.734028    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-mdnts_50363e97-efce-44d6-abff-163d52b45591/cluster-monitoring-operator/0.log"
Jul 29 18:51:18.950800 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:18.950768    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nq7k4_7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58/node-exporter/0.log"
Jul 29 18:51:18.968742 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:18.968716    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nq7k4_7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58/kube-rbac-proxy/0.log"
Jul 29 18:51:18.988263 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:18.988157    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nq7k4_7ad998da-0e2d-4eb4-b1b3-49fda4ecfa58/init-textfile/0.log"
Jul 29 18:51:19.384900 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:19.384833    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-tz84f_4c9864fc-ad26-43fc-8340-b2b7ba524da4/prometheus-operator-admission-webhook/0.log"
Jul 29 18:51:20.664581 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.664542    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"]
Jul 29 18:51:20.665090 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665071    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d62c363-a166-4020-b952-6eb18ddb0763" containerName="payload-pre-processing"
Jul 29 18:51:20.665173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665093    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d62c363-a166-4020-b952-6eb18ddb0763" containerName="payload-pre-processing"
Jul 29 18:51:20.665173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665127    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b81e4b0-a2af-4c4d-b490-c1d479329cee" containerName="revoke-keys"
Jul 29 18:51:20.665173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665137    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b81e4b0-a2af-4c4d-b490-c1d479329cee" containerName="revoke-keys"
Jul 29 18:51:20.665173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665150    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" containerName="payload-processing"
Jul 29 18:51:20.665173 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665159    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" containerName="payload-processing"
Jul 29 18:51:20.665463 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665298    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f9e2ac1-7615-4c7b-a15c-fc177027e3a7" containerName="payload-processing"
Jul 29 18:51:20.665463 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665317    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d62c363-a166-4020-b952-6eb18ddb0763" containerName="payload-pre-processing"
Jul 29 18:51:20.665463 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.665328    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b81e4b0-a2af-4c4d-b490-c1d479329cee" containerName="revoke-keys"
Jul 29 18:51:20.668434 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.668410    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.671078 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.671054    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-569bx\"/\"openshift-service-ca.crt\""
Jul 29 18:51:20.671237 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.671119    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-569bx\"/\"kube-root-ca.crt\""
Jul 29 18:51:20.672507 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.672480    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-569bx\"/\"default-dockercfg-ntx9j\""
Jul 29 18:51:20.675707 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.675677    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"]
Jul 29 18:51:20.777466 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.777435    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-lib-modules\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.777657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.777488    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-proc\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.777657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.777531    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nlhs\" (UniqueName: \"kubernetes.io/projected/f600cbca-c683-4083-8c7d-d48a28421f68-kube-api-access-5nlhs\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.777657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.777577    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-sys\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.777657 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.777592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-podres\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878602 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878560    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-proc\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878602 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nlhs\" (UniqueName: \"kubernetes.io/projected/f600cbca-c683-4083-8c7d-d48a28421f68-kube-api-access-5nlhs\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878638    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-sys\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878655    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-podres\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-proc\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-lib-modules\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-sys\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878833    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-lib-modules\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.878849 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.878835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f600cbca-c683-4083-8c7d-d48a28421f68-podres\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.888160 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.888132    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nlhs\" (UniqueName: \"kubernetes.io/projected/f600cbca-c683-4083-8c7d-d48a28421f68-kube-api-access-5nlhs\") pod \"perf-node-gather-daemonset-qv97j\" (UID: \"f600cbca-c683-4083-8c7d-d48a28421f68\") " pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:20.980121 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:20.980015    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:21.124029 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.123999    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"]
Jul 29 18:51:21.126328 ip-10-0-142-182 kubenswrapper[2563]: W0729 18:51:21.126297    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf600cbca_c683_4083_8c7d_d48a28421f68.slice/crio-596f08fdf79a2ea5c4f38f1a24d7a4ca819f95c913c2ebc6581242e26c270ce7 WatchSource:0}: Error finding container 596f08fdf79a2ea5c4f38f1a24d7a4ca819f95c913c2ebc6581242e26c270ce7: Status 404 returned error can't find the container with id 596f08fdf79a2ea5c4f38f1a24d7a4ca819f95c913c2ebc6581242e26c270ce7
Jul 29 18:51:21.324117 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.324076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j" event={"ID":"f600cbca-c683-4083-8c7d-d48a28421f68","Type":"ContainerStarted","Data":"399c7adfea463e7d5c7779c3e599b9941bb7e32e29897327011cc1ad2d6945da"}
Jul 29 18:51:21.324328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.324144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j" event={"ID":"f600cbca-c683-4083-8c7d-d48a28421f68","Type":"ContainerStarted","Data":"596f08fdf79a2ea5c4f38f1a24d7a4ca819f95c913c2ebc6581242e26c270ce7"}
Jul 29 18:51:21.324328 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.324308    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:21.341127 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.341073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j" podStartSLOduration=1.341058664 podStartE2EDuration="1.341058664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 18:51:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 18:51:21.340281831 +0000 UTC m=+3504.313324011" watchObservedRunningTime="2026-07-29 18:51:21.341058664 +0000 UTC m=+3504.314100843"
Jul 29 18:51:21.426999 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.426967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/2.log"
Jul 29 18:51:21.431602 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.431582    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-ds9rb_e26d40b4-f683-4f0e-8247-07abe58d2a7c/console-operator/3.log"
Jul 29 18:51:21.987613 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:21.987564    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-97fcddd5c-xjb2q_7b45d869-0aa1-4974-ab9d-0a377ff72341/console/0.log"
Jul 29 18:51:22.020836 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:22.020808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-gzjtw_ff0515aa-40f4-464b-8b4c-022889bdfe7e/download-server/0.log"
Jul 29 18:51:22.581734 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:22.581703    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-95krj_bd1a6448-7a11-410f-8f59-86d5241b9b15/volume-data-source-validator/0.log"
Jul 29 18:51:23.684004 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:23.683978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k4ln6_5dedd0eb-7f05-4ffb-b9f2-610dd31224ee/dns/0.log"
Jul 29 18:51:23.704244 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:23.704213    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-k4ln6_5dedd0eb-7f05-4ffb-b9f2-610dd31224ee/kube-rbac-proxy/0.log"
Jul 29 18:51:23.725665 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:23.725638    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vvn4_d3f168e0-407a-4adb-8d08-44483048aa7f/dns-node-resolver/0.log"
Jul 29 18:51:24.317623 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:24.317588    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-979784cf9-xgfpz_6e0df1a9-fb11-466b-a957-c76aa7438a04/registry/0.log"
Jul 29 18:51:24.337808 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:24.337780    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9qcqs_405c33c3-79b1-4f64-8148-2189f0113caa/node-ca/0.log"
Jul 29 18:51:25.442363 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:25.442322    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-89ssf_56ede77f-1efa-485d-a724-050ca8cad2fe/discovery/0.log"
Jul 29 18:51:25.486338 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:25.486311    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786b455d9f-r7fk8_8bd0af73-ea1f-40e1-9320-b94e8f473651/kube-auth-proxy/0.log"
Jul 29 18:51:25.601430 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:25.601396    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kjs6n_3864dce7-cea7-4c15-8605-3ae4cef7292a/payload-pre-processing/0.log"
Jul 29 18:51:25.630283 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:25.630250    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:51:26.447832 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:26.447806    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fnhx4_f5a20281-310c-49b8-814e-2866e60a1b12/serve-healthcheck-canary/0.log"
Jul 29 18:51:26.942174 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:26.942141    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-wv2wc_ca36fce4-4d1c-4b06-95e1-8762ffcad202/insights-operator/0.log"
Jul 29 18:51:26.943691 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:26.943670    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-wv2wc_ca36fce4-4d1c-4b06-95e1-8762ffcad202/insights-operator/1.log"
Jul 29 18:51:27.083397 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:27.083339    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kq8qx_145ec317-33a4-43fd-b3ec-949793c7bbfd/kube-rbac-proxy/0.log"
Jul 29 18:51:27.103811 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:27.103773    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kq8qx_145ec317-33a4-43fd-b3ec-949793c7bbfd/exporter/0.log"
Jul 29 18:51:27.125976 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:27.125951    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kq8qx_145ec317-33a4-43fd-b3ec-949793c7bbfd/extractor/0.log"
Jul 29 18:51:27.340979 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:27.340957    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-569bx/perf-node-gather-daemonset-qv97j"
Jul 29 18:51:29.366396 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:29.366368    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-q922c_8850ccc6-399f-442c-970f-bea3ea2ef73f/manager/0.log"
Jul 29 18:51:29.586457 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:29.586431    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-k7xq8_25307baa-9c6e-49ae-b822-a1e6d416c099/manager/0.log"
Jul 29 18:51:29.867930 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:29.867903    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-zxvtr_f2c0cd6e-dc53-4845-a3f5-088969f54bc0/server/0.log"
Jul 29 18:51:29.946072 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:29.946041    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-728md_91c1c5d7-b3ae-41c9-8ed2-068473a59e3d/manager/0.log"
Jul 29 18:51:30.132721 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:30.132688    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2_5d88c664-c56a-47e3-9617-eefc16b28b1d/manager/0.log"
Jul 29 18:51:30.148863 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:30.148838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5bc8dd9bf6-vgml2_5d88c664-c56a-47e3-9617-eefc16b28b1d/copy-manifests/0.log"
Jul 29 18:51:31.643282 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:31.643251    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-89ssf_56ede77f-1efa-485d-a724-050ca8cad2fe/discovery/0.log"
Jul 29 18:51:31.670412 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:31.670385    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786b455d9f-r7fk8_8bd0af73-ea1f-40e1-9320-b94e8f473651/kube-auth-proxy/0.log"
Jul 29 18:51:31.766062 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:31.766030    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kjs6n_3864dce7-cea7-4c15-8605-3ae4cef7292a/payload-pre-processing/0.log"
Jul 29 18:51:31.786362 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:31.786331    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:51:33.397666 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:33.397633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-89ssf_56ede77f-1efa-485d-a724-050ca8cad2fe/discovery/0.log"
Jul 29 18:51:33.426316 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:33.426286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786b455d9f-r7fk8_8bd0af73-ea1f-40e1-9320-b94e8f473651/kube-auth-proxy/0.log"
Jul 29 18:51:33.524416 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:33.524366    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-kjs6n_3864dce7-cea7-4c15-8605-3ae4cef7292a/payload-pre-processing/0.log"
Jul 29 18:51:33.546792 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:33.546759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-dglr4_b33e7842-85db-4429-aa1f-25a51b844d64/payload-processing/0.log"
Jul 29 18:51:36.444098 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:36.444071    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mp5nn_c6d24d6a-318d-4e68-9c59-7ed2caf68cc8/migrator/0.log"
Jul 29 18:51:36.465527 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:36.465496    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-mp5nn_c6d24d6a-318d-4e68-9c59-7ed2caf68cc8/graceful-termination/0.log"
Jul 29 18:51:37.605746 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:37.605670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:51:37.706209 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:37.706164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-958fx_0107231b-667f-481a-8a44-faaeac9268f7/konnectivity-agent/0.log" limit=1024
Jul 29 18:51:38.029385 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.029301    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/kube-multus-additional-cni-plugins/0.log"
Jul 29 18:51:38.050326 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.050294    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/egress-router-binary-copy/0.log"
Jul 29 18:51:38.070912 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.070883    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/cni-plugins/0.log"
Jul 29 18:51:38.092234 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.092184    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/bond-cni-plugin/0.log"
Jul 29 18:51:38.112210 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.112162    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/routeoverride-cni/0.log"
Jul 29 18:51:38.132488 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.132462    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/whereabouts-cni-bincopy/0.log"
Jul 29 18:51:38.151876 ip-10-0-142-182 kubenswrapper[2563]: I0729 18:51:38.151850    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mdjn9_b68cc3df-89a0-43b1-89e4-0b63d7affa7e/whereabouts-cni/0.log"