Jul 13 03:39:43.835556 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 03:39:43.835569 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 03:39:43.835578 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 03:39:43.835878 ip-10-0-141-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 03:39:53.574842 ip-10-0-141-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 03:39:53.574855 ip-10-0-141-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 70bc2a3ef67a4b459e7d87a78c08409d --
Jul 13 03:41:21.099022 ip-10-0-141-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.544003    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547394    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547404    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547408    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547412    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547415    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547417    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547420    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.555570 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547423    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547426    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547429    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547432    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547435    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547438    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547440    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547443    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547446    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547448    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547451    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547454    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547457    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547460    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547467    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547470    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547472    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547475    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547478    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547480    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.569948 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547483    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547487    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547491    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547494    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547498    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547501    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547504    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547507    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547510    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547513    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547517    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547520    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547523    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547526    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547529    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547532    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547535    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547537    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547540    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.572435 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547544    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547547    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547550    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547552    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547555    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547558    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547560    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547563    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547565    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547568    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547570    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547573    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547576    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547578    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547581    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547584    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547586    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547589    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547592    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.574405 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547595    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547598    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547600    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547603    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547605    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547608    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547610    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547613    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547616    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547618    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547621    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547624    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547626    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547629    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547634    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547636    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547639    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547641    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547643    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.576656 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547646    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547649    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547653    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547656    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547659    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547661    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547664    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547667    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547669    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547672    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547674    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547677    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547679    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547682    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.547684    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548391    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548398    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548401    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548404    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:21.589836 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548409    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548413    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548417    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548420    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548423    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548426    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548429    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548432    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548435    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548439    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548442    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548444    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548448    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548452    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548455    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548458    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548460    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548463    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548466    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:21.592229 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548468    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548471    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548473    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548476    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548478    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548481    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548483    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548486    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548489    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548491    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548493    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548496    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548499    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548502    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548505    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548507    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548510    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548513    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548516    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548518    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.594054 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548521    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548526    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548528    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548531    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548534    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548537    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548539    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548542    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548544    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548547    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548551    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548553    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548556    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548559    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548562    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548564    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548566    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548569    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548572    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548574    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548577    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.596156 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548579    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548582    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548584    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548587    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548589    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548592    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548594    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548597    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548599    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548602    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548604    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548607    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548612    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548616    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548618    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548622    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548624    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548627    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548629    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548632    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:21.601800 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548634    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548638    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548641    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548643    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548646    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548649    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548652    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548655    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548658    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548661    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548663    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548666    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548669    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548672    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.548674    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549085    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549091    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549094    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549097    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.604209 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549099    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549102    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549105    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549107    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549110    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549114    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549116    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549119    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549122    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549125    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549127    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549130    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549132    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549135    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549139    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549142    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549145    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549147    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549150    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549153    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:21.664000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549155    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.621027 ip-10-0-141-187 systemd[1]: Started Kubernetes Kubelet.
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549158    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549160    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549163    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549165    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549168    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549171    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549173    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549176    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549178    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549180    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549183    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549186    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549188    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549191    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549193    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549196    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549200    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549203    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549205    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.719258 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549207    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549210    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549213    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549215    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549218    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549220    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549224    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549226    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549229    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549231    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549234    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549236    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549240    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549243    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549246    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549249    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549252    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549256    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:21.862866 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549260    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549263    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549267    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549269    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549272    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549274    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549277    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549279    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549283    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549286    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549289    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549293    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549295    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549298    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549300    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549303    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549306    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549308    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549311    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549315    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.863988 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549319    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549321    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549324    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549326    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549329    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549331    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549334    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549336    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549339    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549341    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549344    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549346    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549349    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549351    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549353    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549356    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.549359    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549434    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549440    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549446    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549451    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 03:41:21.864676 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549455    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549458    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549463    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549468    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549471    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549474    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549477    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549480    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549484    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549487    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549490    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549497    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549500    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549502    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549507    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549510    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549513    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549516    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549519    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549523    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549526    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549529    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549532    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549536    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 03:41:21.865367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549539    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549542    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549545    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549548    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549552    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549555    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549558    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549561    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549564    2582 flags.go:64] FLAG: --enable-server="true"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549566    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549572    2582 flags.go:64] FLAG: --event-burst="100"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549575    2582 flags.go:64] FLAG: --event-qps="50"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549578    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549581    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549584    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549587    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549590    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549594    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549597    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549601    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549604    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549607    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549609    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549612    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549615    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 03:41:21.866079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549618    2582 flags.go:64] FLAG: --feature-gates=""
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549621    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549624    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549627    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549630    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549633    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549636    2582 flags.go:64] FLAG: --help="false"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549639    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549642    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549645    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549648    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549652    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549655    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549658    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549660    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549663    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549666    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549670    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549674    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549676    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549679    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549682    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549685    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549687    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 03:41:21.866919 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549690    2582 flags.go:64] FLAG: --lock-file=""
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549693    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549698    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549701    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549706    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549709    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549712    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549714    2582 flags.go:64] FLAG: --logging-format="text"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549717    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549720    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549723    2582 flags.go:64] FLAG: --manifest-url=""
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549741    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549746    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549749    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549753    2582 flags.go:64] FLAG: --max-pods="110"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549756    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549759    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549762    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549765    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549768    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549771    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549773    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549781    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549784    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549787    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 03:41:21.867595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549791    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549794    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549800    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549803    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549806    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549809    2582 flags.go:64] FLAG: --port="10250"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549812    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549815    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00fad48b4acdd6061"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549818    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549822    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549825    2582 flags.go:64] FLAG: --register-node="true"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549828    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549832    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549835    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549838    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549841    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549844    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549847    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549850    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549853    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549856    2582 flags.go:64] FLAG: --runonce="false"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549859    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549862    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549865    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549867    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 03:41:21.868959 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549871    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549874    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549876    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549879    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549882    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549885    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549888    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549891    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549895    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549898    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549901    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549906    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549909    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549912    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549916    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549919    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549923    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549926    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549929    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549932    2582 flags.go:64] FLAG: --v="2"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549941    2582 flags.go:64] FLAG: --version="false"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549945    2582 flags.go:64] FLAG: --vmodule=""
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549949    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.549952    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 03:41:21.870306 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550090    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550094    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550097    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550100    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550103    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550106    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550108    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550111    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550113    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550116    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550118    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550121    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550124    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550127    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550129    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550132    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550136    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550139    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550142    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550144    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.871706 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550147    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550150    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550152    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550155    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550159    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550161    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550165    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550167    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550169    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550172    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550175    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550177    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550180    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550182    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550185    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550188    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550190    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550193    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550195    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550198    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:21.873266 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550200    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550203    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550205    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550208    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550212    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550215    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550218    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550221    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550226    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550229    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550232    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550234    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550237    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550240    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550244    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550247    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550252    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550256    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:21.873951 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550259    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550262    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550265    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550267    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550270    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550273    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550276    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550278    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550281    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550283    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550286    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550288    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550291    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550293    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550296    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550298    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550301    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550303    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550306    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550309    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.876231 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550311    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550314    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550318    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550321    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550324    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550326    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550328    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550331    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550333    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550336    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550340    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550343    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550346    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550348    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550351    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550354    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550356    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550359    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550361    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550364    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:21.878503 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.550367    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.550924    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.558336    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.558354    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.558373    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.558383    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558441    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558446    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558450    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558454    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558457    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558460    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558463    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558465    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558468    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.880759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558471    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558473    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558476    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558478    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558481    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558484    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558487    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558489    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558492    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558495    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558498    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558501    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558504    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558507    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558509    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558513    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558515    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558518    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558520    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558523    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.881533 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558526    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558529    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558532    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558534    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558537    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558539    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558542    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558544    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558547    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558549    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558552    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558554    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558559    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558562    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558565    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558568    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558571    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558574    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558577    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.883709 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558580    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558584    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558588    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558591    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558594    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558597    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558599    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558602    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558605    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558609    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558612    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558615    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558618    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558621    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558624    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558627    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558629    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558632    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558635    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.885392 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558637    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558640    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558642    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558645    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558648    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558650    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558653    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558656    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558659    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558661    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558664    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558667    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558670    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558672    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558691    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558697    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558700    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558703    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558706    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558709    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.886282 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558712    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558715    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558718    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558721    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558741    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558746    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558748    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558751    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558755    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558758    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558760    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558763    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.558768    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558890    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558896    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 03:41:21.887112 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558899    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558902    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558905    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558907    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558910    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558912    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558915    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558918    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558920    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558922    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558925    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558928    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558930    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558933    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558936    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558939    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558941    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558944    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558947    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558949    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 03:41:21.889577 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558952    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558954    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558957    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558960    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558962    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558965    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558968    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558971    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558974    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558976    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558979    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558982    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558985    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558987    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558989    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558992    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558994    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.558997    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559000    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559003    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 03:41:21.890339 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559005    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559007    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559010    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559012    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559015    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559018    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559020    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559023    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559025    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559027    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559030    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559032    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559035    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559038    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559043    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559045    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559048    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559053    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559056    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559060    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 03:41:22.072399 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559062    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559065    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559067    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559070    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559073    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559075    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559078    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559080    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559083    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559086    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559089    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559093    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559096    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559099    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559102    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559105    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559108    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559111    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559116    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 03:41:22.073101 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559119    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559122    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559125    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559128    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559131    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559133    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559136    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559139    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559141    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559144    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559147    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559150    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559153    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559156    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559159    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559161    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559164    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 03:41:22.073663 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:21.559167    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.559172    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.559305    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.561804    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.563048    2582 server.go:1019] "Starting client certificate rotation"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.563147    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.563867    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.565921    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.567028    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.586104    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.589918    2582 log.go:25] "Validated CRI v1 image API"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.592369    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 03:41:22.074180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.595471    2582 fs.go:135] Filesystem UUIDs: map[1a35d55d-2803-4430-80c3-2aa27f540b14:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87c9d57c-10cb-40a6-98f2-cb4cf7efc51b:/dev/nvme0n1p3]
Jul 13 03:41:22.074538 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.595487    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 03:41:22.074538 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.598854    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.600538    2582 manager.go:216] Machine: {Timestamp:2026-07-13 03:41:21.599219959 +0000 UTC m=+0.374934230 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100227 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228cb50f290aa0166a1d810db9496d SystemUUID:ec228cb5-0f29-0aa0-166a-1d810db9496d BootID:70bc2a3e-f67a-4b45-9e7d-87a78c08409d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:38:5a:61:47:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:38:5a:61:47:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:e4:dd:79:26:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.600644    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.600746    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.603950    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.603982    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.604683    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.604692    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.604700    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.604713    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.605767    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609230    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609352    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609390    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609412    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609449    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609465    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609484    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 03:41:22.074700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609932    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.609948    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.611916    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.613660    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.613693    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614888    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614901    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614906    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614913    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614921    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614927    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614935    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614941    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614947    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614953    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614966    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.614971    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.616524    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.616534    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.619306    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h425c"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.619971    2582 server.go:1268] "Started kubelet"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.620056    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.620143    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.620210    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.620413    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.620465    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.620584    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.622487    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.624007    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.624886    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h425c"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.626827    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.624933    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-187.ec2.internal.18c1bc67d8c6194b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-187.ec2.internal,UID:ip-10-0-141-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-187.ec2.internal,},FirstTimestamp:2026-07-13 03:41:21.619941707 +0000 UTC m=+0.395655978,LastTimestamp:2026-07-13 03:41:21.619941707 +0000 UTC m=+0.395655978,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-187.ec2.internal,}"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.630369    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.630371    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.630500    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.630979    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.630987    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.630997    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631126    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631135    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 03:41:22.075312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631223    2582 factory.go:55] Registering systemd factory
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631235    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631656    2582 factory.go:153] Registering CRI-O factory
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631670    2582 factory.go:223] Registration of the crio container factory successfully
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631721    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631768    2582 factory.go:103] Registering Raw factory
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.631784    2582 manager.go:1196] Started watching for new ooms in manager
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.632185    2582 manager.go:349] Starting recovery of all containers
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.642667    2582 manager.go:354] Recovery completed
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.642800    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.648223    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.650511    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652021    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652052    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652062    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652614    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652622    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652639    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.652665    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.653885    2582 policy_none.go:49] "None policy: Start"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.653897    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.653907    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.654602    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.654632    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.654643    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.654879    2582 policy_none.go:47] "Start"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.730548    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749321    2582 manager.go:337] "Starting Device Plugin manager"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.749353    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749364    2582 server.go:87] "Starting device plugin registration server"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749678    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749692    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749784    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749884    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.749894    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.750616    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.750658    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.752475    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.753744    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.753794    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.753818    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.753857    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.756146    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.850470    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.851977    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.852026    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.852041    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.852099    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.076407 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.854224    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"]
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.854310    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.855101    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.855125    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.855134    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.856376    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.856506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.856530    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857062    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857089    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857098    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857062    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857170    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.857181    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.858359    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.858385    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.859294    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.859318    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.859333    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeHasSufficientPID"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.860979    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.861129    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-187.ec2.internal\": node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.872927    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.892821    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.897634    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-187.ec2.internal\" not found" node="ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.931395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.931420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a756bfda3d81489a4206188fd0c02f7c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"a756bfda3d81489a4206188fd0c02f7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:21.931437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:21.973389    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032311    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.077695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.078462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032388    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.078462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a756bfda3d81489a4206188fd0c02f7c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"a756bfda3d81489a4206188fd0c02f7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.078462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a756bfda3d81489a4206188fd0c02f7c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-187.ec2.internal\" (UID: \"a756bfda3d81489a4206188fd0c02f7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.078462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.032475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e02a4fbd6e69813a57614cb09ba8bf40-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal\" (UID: \"e02a4fbd6e69813a57614cb09ba8bf40\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.078462 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.073459    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.179635 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.174041    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.263294 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.195201    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.263294 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.200980    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:22.365215 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.275116    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.554158 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.375674    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.554158 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.475828    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.562215    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.562369    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.562416    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.575915    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.630949    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 03:36:22 +0000 UTC" deadline="2028-03-06 22:36:06.542395216 +0000 UTC"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.630985    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14466h54m43.911415223s"
Jul 13 03:41:22.711503 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.676392    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.778785    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.836990    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:22.850232    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda756bfda3d81489a4206188fd0c02f7c.slice/crio-347e746d6dc573c8f1c1e343a5ac78a4c7c9fbaa8285cb9e745c51b0afdedb2a WatchSource:0}: Error finding container 347e746d6dc573c8f1c1e343a5ac78a4c7c9fbaa8285cb9e745c51b0afdedb2a: Status 404 returned error can't find the container with id 347e746d6dc573c8f1c1e343a5ac78a4c7c9fbaa8285cb9e745c51b0afdedb2a
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:22.850756    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02a4fbd6e69813a57614cb09ba8bf40.slice/crio-b57b433a87ef631b062fe8485b64c7ff2804fe20c524597e267f38860ecca2c8 WatchSource:0}: Error finding container b57b433a87ef631b062fe8485b64c7ff2804fe20c524597e267f38860ecca2c8: Status 404 returned error can't find the container with id b57b433a87ef631b062fe8485b64c7ff2804fe20c524597e267f38860ecca2c8
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:22.855584    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:41:22.904308 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.879716    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:23.027044 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:22.979921    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-187.ec2.internal\" not found"
Jul 13 03:41:23.183575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.059353    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:23.183575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.131828    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:23.183575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.142535    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 03:41:23.183575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.143514    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal"
Jul 13 03:41:23.183575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.151339    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 03:41:23.424243 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.376088    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:23.624943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.624917    2582 apiserver.go:52] "Watching apiserver"
Jul 13 03:41:23.631100 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.631078    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 03:41:23.636874 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.635891    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 03:41:23.636874 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.636428    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fks58","kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs","openshift-dns/node-resolver-b8f79","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal","openshift-multus/multus-additional-cni-plugins-sllkc","openshift-multus/multus-rmchl","openshift-multus/network-metrics-daemon-7fmf2","kube-system/konnectivity-agent-5jcsz","openshift-cluster-node-tuning-operator/tuned-jxzll","openshift-image-registry/node-ca-xjbxn","openshift-network-diagnostics/network-check-target-zn6ft","openshift-network-operator/iptables-alerter-zj4z6","openshift-ovn-kubernetes/ovnkube-node-rx4gx"]
Jul 13 03:41:23.638153 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.638057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.639608 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.639583    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.640776 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.640752    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.642350 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.642329    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 03:41:23.642569 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.642544    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.645596 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.645215    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 03:41:23.646556 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.646228    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 03:41:23.646556 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.642331    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.647306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.647195    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 03:41:23.647306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.647234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.647306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.647247    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.647306 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.647299    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 03:41:23.650682 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.648137    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.650682 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.648441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-flmxd\""
Jul 13 03:41:23.650682 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.648446    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.650682 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.648753    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.650682 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.650408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vnxtb\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.651649    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.651761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vlw2c\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.652442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6t8dz\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.652709    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.653033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.653314    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.654277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.653357    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 03:41:23.655672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655287    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.655672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655361    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.655672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 03:41:23.655672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655631    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 03:41:23.655954 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.655954 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.655839    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 03:41:23.656456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.656215    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2c55k\""
Jul 13 03:41:23.656456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.656239    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 03:41:23.656456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.656295    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6gglj\""
Jul 13 03:41:23.657351 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.657334    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 03:41:23.658669 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.657999    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.659260 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.658770    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 03:41:23.659760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.659734    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4hpn8\""
Jul 13 03:41:23.659932 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.659629    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.659997 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.659931    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:23.660348 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.658899    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 03:41:23.661026 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.661005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.661396 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.661380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.661835 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.661625    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 03:41:23.661835 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.661703    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xrngf\""
Jul 13 03:41:23.661835 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.661787    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.662939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.662868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.663010 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.662937    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:23.663213 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.663185    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hpzp"
Jul 13 03:41:23.663715 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.663564    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 03:41:23.663715 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.663566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lcgp2\""
Jul 13 03:41:23.664234 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.664081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 03:41:23.667405 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.667373    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:23.667506 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.667446    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:23.673623 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.673600    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9hpzp"
Jul 13 03:41:23.732953 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.732932    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 03:41:23.760203 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760152    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"e02a4fbd6e69813a57614cb09ba8bf40","Type":"ContainerStarted","Data":"b57b433a87ef631b062fe8485b64c7ff2804fe20c524597e267f38860ecca2c8"}
Jul 13 03:41:23.760598 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760566    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-kubelet\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.760706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59dde4e2-5c97-4c8a-b822-12010aebafa2-serviceca\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.760706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90b58b40-a7cd-44a2-8671-7e82728cf5f5-hosts-file\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.760706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.760706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-k8s-cni-cncf-io\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.760706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-hostroot\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7rx2\" (UniqueName: \"kubernetes.io/projected/95c21b33-8864-44e3-a354-34ac91133951-kube-api-access-w7rx2\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysconfig\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760776    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-kubernetes\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-dbus\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-system-cni-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss6mv\" (UniqueName: \"kubernetes.io/projected/5f382543-7683-4be0-9ec4-13235f17f452-kube-api-access-ss6mv\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-var-lib-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c36e1048-4bb5-4d72-b72d-caf0b44de93e-agent-certs\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760944    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-lib-modules\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.760968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-etc-kubernetes\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.761012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-conf\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-run\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-tmp\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-multus-daemon-config\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-netd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-config\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltcsv\" (UniqueName: \"kubernetes.io/projected/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-kube-api-access-ltcsv\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761270    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-sys\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-device-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/90b58b40-a7cd-44a2-8671-7e82728cf5f5-kube-api-access-9tpxs\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-systemd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-env-overrides\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4swh\" (UniqueName: \"kubernetes.io/projected/5750286c-524f-47e3-a18f-3a4d6fef1c5b-kube-api-access-p4swh\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-cnibin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.761537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-socket-dir-parent\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-slash\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761510    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovn-node-metrics-cert\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761604    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-script-lib\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761648    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-host\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761678    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59dde4e2-5c97-4c8a-b822-12010aebafa2-host\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-socket-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-os-release\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtdpw\" (UniqueName: \"kubernetes.io/projected/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-kube-api-access-qtdpw\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-cni-binary-copy\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-log-socket\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-bin\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.762316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c21b33-8864-44e3-a354-34ac91133951-host-slash\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.761974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-modprobe-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762001    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7rmw\" (UniqueName: \"kubernetes.io/projected/59dde4e2-5c97-4c8a-b822-12010aebafa2-kube-api-access-j7rmw\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-os-release\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-netns\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-bin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-kubelet\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-kubelet-config\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5f9\" (UniqueName: \"kubernetes.io/projected/06aba64f-5230-4113-aee1-20243a42537a-kube-api-access-sk5f9\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-multus-certs\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-registration-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90b58b40-a7cd-44a2-8671-7e82728cf5f5-tmp-dir\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cnibin\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762367    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.763073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-conf-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-ovn\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-systemd\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762504    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-tuned\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t69n\" (UniqueName: \"kubernetes.io/projected/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-kube-api-access-9t69n\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-system-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-multus\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762652    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-systemd-units\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762679    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-netns\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-node-log\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95c21b33-8864-44e3-a354-34ac91133951-iptables-alerter-script\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-etc-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-var-lib-kubelet\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.763822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.764504 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.762968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-sys-fs\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.764504 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.763006    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c36e1048-4bb5-4d72-b72d-caf0b44de93e-konnectivity-ca\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.764504 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.763286    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"a756bfda3d81489a4206188fd0c02f7c","Type":"ContainerStarted","Data":"347e746d6dc573c8f1c1e343a5ac78a4c7c9fbaa8285cb9e745c51b0afdedb2a"}
Jul 13 03:41:23.776272 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.776205    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 03:41:23.863790 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-k8s-cni-cncf-io\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863871    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-k8s-cni-cncf-io\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-hostroot\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863823    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-hostroot\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7rx2\" (UniqueName: \"kubernetes.io/projected/95c21b33-8864-44e3-a354-34ac91133951-kube-api-access-w7rx2\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863943    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysconfig\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.863967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-kubernetes\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.863990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-dbus\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-system-cni-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss6mv\" (UniqueName: \"kubernetes.io/projected/5f382543-7683-4be0-9ec4-13235f17f452-kube-api-access-ss6mv\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-var-lib-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c36e1048-4bb5-4d72-b72d-caf0b44de93e-agent-certs\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-lib-modules\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864125    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-etc-kubernetes\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864164    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-conf\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-run\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864227    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-tmp\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864249    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-multus-daemon-config\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-netd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864334    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-dbus\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-system-cni-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864339    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-netd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.864498    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:23.864632 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.864593    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:24.364551605 +0000 UTC m=+3.140265870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864673    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-conf\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864690    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysconfig\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864731    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-run\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-kubernetes\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-config\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-var-lib-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltcsv\" (UniqueName: \"kubernetes.io/projected/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-kube-api-access-ltcsv\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-sys\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-device-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.864948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/90b58b40-a7cd-44a2-8671-7e82728cf5f5-kube-api-access-9tpxs\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.864977    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-systemd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-env-overrides\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4swh\" (UniqueName: \"kubernetes.io/projected/5750286c-524f-47e3-a18f-3a4d6fef1c5b-kube-api-access-p4swh\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-cnibin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-device-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-socket-dir-parent\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-slash\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-socket-dir-parent\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-cnibin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-systemd\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovn-node-metrics-cert\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865273    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-slash\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-script-lib\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-host\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.865424 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59dde4e2-5c97-4c8a-b822-12010aebafa2-host\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-socket-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-os-release\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865513    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtdpw\" (UniqueName: \"kubernetes.io/projected/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-kube-api-access-qtdpw\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865544    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-etc-kubernetes\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-config\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-lib-modules\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovnkube-script-lib\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-cni-binary-copy\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-socket-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-host\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866198    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-os-release\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/59dde4e2-5c97-4c8a-b822-12010aebafa2-host\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.866335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866328    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-sys\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.865552    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-cni-binary-copy\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866864    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-env-overrides\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5f382543-7683-4be0-9ec4-13235f17f452-multus-daemon-config\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.866967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-log-socket\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-bin\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c21b33-8864-44e3-a354-34ac91133951-host-slash\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-modprobe-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-log-socket\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7rmw\" (UniqueName: \"kubernetes.io/projected/59dde4e2-5c97-4c8a-b822-12010aebafa2-kube-api-access-j7rmw\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-os-release\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/95c21b33-8864-44e3-a354-34ac91133951-host-slash\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-netns\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-bin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-kubelet\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.867244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867236    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-kubelet-config\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5f9\" (UniqueName: \"kubernetes.io/projected/06aba64f-5230-4113-aee1-20243a42537a-kube-api-access-sk5f9\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-multus-certs\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867298    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-registration-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867339    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90b58b40-a7cd-44a2-8671-7e82728cf5f5-tmp-dir\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867364    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cnibin\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-netns\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-modprobe-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-sysctl-d\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-bin\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-cni-bin\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-conf-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-kubelet\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-registration-dir\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-ovn\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1889e832-d11e-4813-85ce-c9472ecfa0a0-kubelet-config\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-run-multus-certs\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867560    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-systemd\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-tuned\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cnibin\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867623    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t69n\" (UniqueName: \"kubernetes.io/projected/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-kube-api-access-9t69n\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-system-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867676    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-multus\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-host-var-lib-cni-multus\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90b58b40-a7cd-44a2-8671-7e82728cf5f5-tmp-dir\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-os-release\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-systemd-units\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-run-ovn\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-netns\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.868939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867890    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-multus-conf-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.867991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-node-log\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-netns\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868023    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95c21b33-8864-44e3-a354-34ac91133951-iptables-alerter-script\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5f382543-7683-4be0-9ec4-13235f17f452-system-cni-dir\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-systemd\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-run-ovn-kubernetes\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-systemd-units\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-etc-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868246    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-var-lib-kubelet\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868318    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-var-lib-kubelet\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-sys-fs\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868358    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-etc-openvswitch\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.869903 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c36e1048-4bb5-4d72-b72d-caf0b44de93e-konnectivity-ca\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-kubelet\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868418    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59dde4e2-5c97-4c8a-b822-12010aebafa2-serviceca\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90b58b40-a7cd-44a2-8671-7e82728cf5f5-hosts-file\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.868470    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868510    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/90b58b40-a7cd-44a2-8671-7e82728cf5f5-hosts-file\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.868526    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:24.368508103 +0000 UTC m=+3.144222383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868547    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-host-kubelet\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868672    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/06aba64f-5230-4113-aee1-20243a42537a-sys-fs\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/95c21b33-8864-44e3-a354-34ac91133951-iptables-alerter-script\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-node-log\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c36e1048-4bb5-4d72-b72d-caf0b44de93e-konnectivity-ca\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.868952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/59dde4e2-5c97-4c8a-b822-12010aebafa2-serviceca\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.869096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-cni-binary-copy\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.870750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.870075    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-ovn-node-metrics-cert\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.875380 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.872151    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-tmp\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.875380 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.872432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-etc-tuned\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.875380 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.872553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c36e1048-4bb5-4d72-b72d-caf0b44de93e-agent-certs\") pod \"konnectivity-agent-5jcsz\" (UID: \"c36e1048-4bb5-4d72-b72d-caf0b44de93e\") " pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:23.877866 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.877812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss6mv\" (UniqueName: \"kubernetes.io/projected/5f382543-7683-4be0-9ec4-13235f17f452-kube-api-access-ss6mv\") pod \"multus-rmchl\" (UID: \"5f382543-7683-4be0-9ec4-13235f17f452\") " pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.877982 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.877898    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:23.877982 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.877920    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:23.877982 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.877934    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:23.878176 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:23.878004    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:24.377986487 +0000 UTC m=+3.153700750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:23.880422 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.880393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t69n\" (UniqueName: \"kubernetes.io/projected/2b5e3585-8c4d-4b0b-89d9-0b1ab080a559-kube-api-access-9t69n\") pod \"tuned-jxzll\" (UID: \"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559\") " pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:23.882976 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.882931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tpxs\" (UniqueName: \"kubernetes.io/projected/90b58b40-a7cd-44a2-8671-7e82728cf5f5-kube-api-access-9tpxs\") pod \"node-resolver-b8f79\" (UID: \"90b58b40-a7cd-44a2-8671-7e82728cf5f5\") " pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:23.884446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.883923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7rx2\" (UniqueName: \"kubernetes.io/projected/95c21b33-8864-44e3-a354-34ac91133951-kube-api-access-w7rx2\") pod \"iptables-alerter-zj4z6\" (UID: \"95c21b33-8864-44e3-a354-34ac91133951\") " pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:23.884446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.884256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7rmw\" (UniqueName: \"kubernetes.io/projected/59dde4e2-5c97-4c8a-b822-12010aebafa2-kube-api-access-j7rmw\") pod \"node-ca-xjbxn\" (UID: \"59dde4e2-5c97-4c8a-b822-12010aebafa2\") " pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.884446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.884270    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltcsv\" (UniqueName: \"kubernetes.io/projected/f2d053e8-5c6a-4bc9-92da-eba0bf0f4809-kube-api-access-ltcsv\") pod \"ovnkube-node-rx4gx\" (UID: \"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809\") " pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:23.884446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.884408    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4swh\" (UniqueName: \"kubernetes.io/projected/5750286c-524f-47e3-a18f-3a4d6fef1c5b-kube-api-access-p4swh\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:23.885175 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.885152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5f9\" (UniqueName: \"kubernetes.io/projected/06aba64f-5230-4113-aee1-20243a42537a-kube-api-access-sk5f9\") pod \"aws-ebs-csi-driver-node-kn4xs\" (UID: \"06aba64f-5230-4113-aee1-20243a42537a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.886464 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.886399    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtdpw\" (UniqueName: \"kubernetes.io/projected/6b6e5938-52d8-4c7f-966c-0c1889b2fd7e-kube-api-access-qtdpw\") pod \"multus-additional-cni-plugins-sllkc\" (UID: \"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e\") " pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:23.956106 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.956066    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rmchl"
Jul 13 03:41:23.967080 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.967057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xjbxn"
Jul 13 03:41:23.977882 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.977857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs"
Jul 13 03:41:23.992643 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:23.992614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-b8f79"
Jul 13 03:41:24.000380 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.000356    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:24.008116 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.008096    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sllkc"
Jul 13 03:41:24.016898 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.016876    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:24.026594 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.026545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zj4z6"
Jul 13 03:41:24.036353 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.036333    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jxzll"
Jul 13 03:41:24.372127 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.372028    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:24.372295 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.372130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:24.372295 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.372228    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:24.372295 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.372247    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:24.372473 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.372311    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:25.372292707 +0000 UTC m=+4.148006984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:24.372473 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.372343    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:25.372322139 +0000 UTC m=+4.148036404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:24.472881 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.472834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:24.473071 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.472994    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:24.473071 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.473021    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:24.473071 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.473034    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:24.473208 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:24.473102    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:25.473081129 +0000 UTC m=+4.248795392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:24.675885 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.675777    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 03:36:24 +0000 UTC" deadline="2027-12-08 08:12:48.627588949 +0000 UTC"
Jul 13 03:41:24.675885 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:24.675831    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12316h31m23.951760331s"
Jul 13 03:41:24.934636 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.934610    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36e1048_4bb5_4d72_b72d_caf0b44de93e.slice/crio-b7124e01dd8b53b7528812fb593c53360ec48993ccc9453e6b881255d8644aee WatchSource:0}: Error finding container b7124e01dd8b53b7528812fb593c53360ec48993ccc9453e6b881255d8644aee: Status 404 returned error can't find the container with id b7124e01dd8b53b7528812fb593c53360ec48993ccc9453e6b881255d8644aee
Jul 13 03:41:24.952062 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.952037    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d053e8_5c6a_4bc9_92da_eba0bf0f4809.slice/crio-3a34c8aaf010030235769f4d9aecbe223dea59dd19d0cd7f2ba495d6132f0c8b WatchSource:0}: Error finding container 3a34c8aaf010030235769f4d9aecbe223dea59dd19d0cd7f2ba495d6132f0c8b: Status 404 returned error can't find the container with id 3a34c8aaf010030235769f4d9aecbe223dea59dd19d0cd7f2ba495d6132f0c8b
Jul 13 03:41:24.954636 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.954607    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90b58b40_a7cd_44a2_8671_7e82728cf5f5.slice/crio-c8307e65a6790e9dcb8035fd701dbf179cb73a0514a45dbc700fb9a5f51126a9 WatchSource:0}: Error finding container c8307e65a6790e9dcb8035fd701dbf179cb73a0514a45dbc700fb9a5f51126a9: Status 404 returned error can't find the container with id c8307e65a6790e9dcb8035fd701dbf179cb73a0514a45dbc700fb9a5f51126a9
Jul 13 03:41:24.955241 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.955217    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c21b33_8864_44e3_a354_34ac91133951.slice/crio-a59a957bd902cf0b00c31a644402bc3e9dcd549a2e67b591c3f38976803e32b3 WatchSource:0}: Error finding container a59a957bd902cf0b00c31a644402bc3e9dcd549a2e67b591c3f38976803e32b3: Status 404 returned error can't find the container with id a59a957bd902cf0b00c31a644402bc3e9dcd549a2e67b591c3f38976803e32b3
Jul 13 03:41:24.956417 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.956384    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06aba64f_5230_4113_aee1_20243a42537a.slice/crio-8dd691c026c57d83d1546aa43d3f2fda7938e5c9b0adcfe0e18501d0af9927a7 WatchSource:0}: Error finding container 8dd691c026c57d83d1546aa43d3f2fda7938e5c9b0adcfe0e18501d0af9927a7: Status 404 returned error can't find the container with id 8dd691c026c57d83d1546aa43d3f2fda7938e5c9b0adcfe0e18501d0af9927a7
Jul 13 03:41:24.958460 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.958437    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f382543_7683_4be0_9ec4_13235f17f452.slice/crio-271f1ae3aa76536cf8308bcaadcb50d2e213fc30dbb4750d35077d06db3312f4 WatchSource:0}: Error finding container 271f1ae3aa76536cf8308bcaadcb50d2e213fc30dbb4750d35077d06db3312f4: Status 404 returned error can't find the container with id 271f1ae3aa76536cf8308bcaadcb50d2e213fc30dbb4750d35077d06db3312f4
Jul 13 03:41:24.959834 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.959435    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5e3585_8c4d_4b0b_89d9_0b1ab080a559.slice/crio-6bfddea2d95a0c746412470061843f28ddf9482740e4cd345a1cdbca21b608c9 WatchSource:0}: Error finding container 6bfddea2d95a0c746412470061843f28ddf9482740e4cd345a1cdbca21b608c9: Status 404 returned error can't find the container with id 6bfddea2d95a0c746412470061843f28ddf9482740e4cd345a1cdbca21b608c9
Jul 13 03:41:24.960268 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.960245    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6e5938_52d8_4c7f_966c_0c1889b2fd7e.slice/crio-70279e23a7dd430f2da4fcdbf6c84e06a9ea71be83213d4a40f905c7bab39831 WatchSource:0}: Error finding container 70279e23a7dd430f2da4fcdbf6c84e06a9ea71be83213d4a40f905c7bab39831: Status 404 returned error can't find the container with id 70279e23a7dd430f2da4fcdbf6c84e06a9ea71be83213d4a40f905c7bab39831
Jul 13 03:41:24.962749 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:24.961937    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dde4e2_5c97_4c8a_b822_12010aebafa2.slice/crio-11ef9c3bceaf59b8f31a5d5872063e037e1aefc82f3502914bead399328469fe WatchSource:0}: Error finding container 11ef9c3bceaf59b8f31a5d5872063e037e1aefc82f3502914bead399328469fe: Status 404 returned error can't find the container with id 11ef9c3bceaf59b8f31a5d5872063e037e1aefc82f3502914bead399328469fe
Jul 13 03:41:25.381511 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.380627    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:25.381511 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.381051    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:25.381511 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.380821    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:25.381511 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.381197    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:27.381181392 +0000 UTC m=+6.156895652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:25.381858 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.381143    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:25.381858 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.381604    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:27.381587713 +0000 UTC m=+6.157301975 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:25.482846 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.482126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:25.482846 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.482334    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:25.482846 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.482357    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:25.482846 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.482370    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:25.482846 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.482431    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:27.48241179 +0000 UTC m=+6.258126091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:25.676320 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.676274    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 03:36:24 +0000 UTC" deadline="2027-12-12 06:52:11.961651072 +0000 UTC"
Jul 13 03:41:25.676320 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.676318    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12411h10m46.285337937s"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.762375    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.762549    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.762930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.763105    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.763554    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:25.763760 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:25.763667    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:25.793061 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.792760    2582 generic.go:356] "Generic (PLEG): container finished" podID="e02a4fbd6e69813a57614cb09ba8bf40" containerID="6b6951051a082eb7910c7f949bbb2f6afc7ef8fb277613d8b61091459935f798" exitCode=0
Jul 13 03:41:25.793061 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.792878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"e02a4fbd6e69813a57614cb09ba8bf40","Type":"ContainerDied","Data":"6b6951051a082eb7910c7f949bbb2f6afc7ef8fb277613d8b61091459935f798"}
Jul 13 03:41:25.813078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.813017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerStarted","Data":"70279e23a7dd430f2da4fcdbf6c84e06a9ea71be83213d4a40f905c7bab39831"}
Jul 13 03:41:25.815440 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.815411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jxzll" event={"ID":"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559","Type":"ContainerStarted","Data":"6bfddea2d95a0c746412470061843f28ddf9482740e4cd345a1cdbca21b608c9"}
Jul 13 03:41:25.819941 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.819917    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmchl" event={"ID":"5f382543-7683-4be0-9ec4-13235f17f452","Type":"ContainerStarted","Data":"271f1ae3aa76536cf8308bcaadcb50d2e213fc30dbb4750d35077d06db3312f4"}
Jul 13 03:41:25.828281 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.828251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs" event={"ID":"06aba64f-5230-4113-aee1-20243a42537a","Type":"ContainerStarted","Data":"8dd691c026c57d83d1546aa43d3f2fda7938e5c9b0adcfe0e18501d0af9927a7"}
Jul 13 03:41:25.830342 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.830319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zj4z6" event={"ID":"95c21b33-8864-44e3-a354-34ac91133951","Type":"ContainerStarted","Data":"a59a957bd902cf0b00c31a644402bc3e9dcd549a2e67b591c3f38976803e32b3"}
Jul 13 03:41:25.833821 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.833620    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8f79" event={"ID":"90b58b40-a7cd-44a2-8671-7e82728cf5f5","Type":"ContainerStarted","Data":"c8307e65a6790e9dcb8035fd701dbf179cb73a0514a45dbc700fb9a5f51126a9"}
Jul 13 03:41:25.840584 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.840496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5jcsz" event={"ID":"c36e1048-4bb5-4d72-b72d-caf0b44de93e","Type":"ContainerStarted","Data":"b7124e01dd8b53b7528812fb593c53360ec48993ccc9453e6b881255d8644aee"}
Jul 13 03:41:25.851758 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.851142    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" event={"ID":"a756bfda3d81489a4206188fd0c02f7c","Type":"ContainerStarted","Data":"eebe5ffb3e90cae71deecb296c14c3da6a96a3852658c3d1693e8fc2f322ad33"}
Jul 13 03:41:25.867007 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.866028    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-187.ec2.internal" podStartSLOduration=2.866009195 podStartE2EDuration="2.866009195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:25.865869285 +0000 UTC m=+4.641583569" watchObservedRunningTime="2026-07-13 03:41:25.866009195 +0000 UTC m=+4.641723481"
Jul 13 03:41:25.870607 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.870546    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjbxn" event={"ID":"59dde4e2-5c97-4c8a-b822-12010aebafa2","Type":"ContainerStarted","Data":"11ef9c3bceaf59b8f31a5d5872063e037e1aefc82f3502914bead399328469fe"}
Jul 13 03:41:25.900024 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:25.899992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"3a34c8aaf010030235769f4d9aecbe223dea59dd19d0cd7f2ba495d6132f0c8b"}
Jul 13 03:41:26.913305 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:26.913169    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" event={"ID":"e02a4fbd6e69813a57614cb09ba8bf40","Type":"ContainerStarted","Data":"61b29913d7447ab08f40dbfcf569616054974e37019862f36dccf959798e65fc"}
Jul 13 03:41:27.415225 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.415183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:27.415426 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.415253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:27.415426 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.415384    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:27.415654 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.415447    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:31.415428652 +0000 UTC m=+10.191142915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:27.415828 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.415788    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:27.415897 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.415886    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:31.415867535 +0000 UTC m=+10.191581835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:27.515836 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.515778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:27.516012 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.515995    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:27.516076 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.516021    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:27.516076 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.516034    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:27.516194 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.516095    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:31.516076524 +0000 UTC m=+10.291790787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:27.754918 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.754836    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:27.755090 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.754976    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:27.755399 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.755378    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:27.755517 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.755495    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:27.755576 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:27.755556    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:27.755963 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:27.755629    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:29.754820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:29.754784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:29.755786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:29.754932    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:29.755786 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:29.755338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:29.755786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:29.755449    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:29.755786 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:29.755485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:29.755786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:29.755559    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:31.454460 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.454412    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:31.454977 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.454523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:31.454977 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.454645    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:31.454977 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.454665    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:31.454977 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.454700    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:39.454686164 +0000 UTC m=+18.230400425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:31.454977 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.454758    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:39.454718773 +0000 UTC m=+18.230433057 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:31.555471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.555427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:31.555657 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.555630    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:31.555657 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.555652    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:31.555770 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.555664    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:31.555770 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.555729    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:39.555709018 +0000 UTC m=+18.331423304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:31.755857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.755765    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:31.756022 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.755904    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:31.757251 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.756166    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:31.757251 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.756278    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:31.757251 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:31.756299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:31.757251 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:31.756414    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:33.754341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:33.754480    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:33.754909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:33.754997    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:33.755064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:33.755803 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:33.755147    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:35.754856 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:35.754808    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:35.755406 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:35.754946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:35.755406 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:35.754960    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:35.755406 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:35.755052    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:35.755406 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:35.755093    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:35.755406 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:35.755180    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:37.754294 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:37.754252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:37.754796 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:37.754257    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:37.754796 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:37.754378    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:37.754796 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:37.754500    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:37.754796 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:37.754258    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:37.754796 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:37.754600    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:39.515357 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.515325    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:39.515898 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.515368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:39.515898 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.515482    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:39.515898 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.515481    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:39.515898 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.515529    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:41:55.515516231 +0000 UTC m=+34.291230490 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:39.515898 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.515549    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:55.515538268 +0000 UTC m=+34.291252526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:39.616507 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.616476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:39.616699 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.616639    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:39.616699 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.616659    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:39.616699 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.616670    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:39.616890 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.616744    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:55.616707567 +0000 UTC m=+34.392421845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:39.754846 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.754816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:39.754846 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.754845    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:39.755074 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:39.754818    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:39.755074 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.754951    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:39.755074 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.755019    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:39.755268 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:39.755127    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:41.754846 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:41.754813    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:41.755260 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:41.754891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:41.755260 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:41.754895    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:41.755260 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:41.755007    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:41.755260 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:41.755077    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:41.755260 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:41.755171    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:43.754580 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:43.754545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:43.755042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:43.754550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:43.755042 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:43.754678    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:43.755042 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:43.754777    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:43.755042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:43.754798    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:43.755042 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:43.754882    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:44.950411 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.950012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5jcsz" event={"ID":"c36e1048-4bb5-4d72-b72d-caf0b44de93e","Type":"ContainerStarted","Data":"26b374a335e9277d11de2423f61e0e2f2d71bb2b23002f4d32346be1b7a6d813"}
Jul 13 03:41:44.951679 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.951646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xjbxn" event={"ID":"59dde4e2-5c97-4c8a-b822-12010aebafa2","Type":"ContainerStarted","Data":"3be05719e985cd297b354a80cdf6333519ade623c768b04832a96cffea8e51ed"}
Jul 13 03:41:44.954615 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.954595    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:41:44.955007 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.954977    2582 generic.go:356] "Generic (PLEG): container finished" podID="f2d053e8-5c6a-4bc9-92da-eba0bf0f4809" containerID="4c089aa784491d12652cff41d32e93a741d20dbae3fb09a195a765acbda0322d" exitCode=1
Jul 13 03:41:44.955080 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955030    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"08aca463f309e6c5f24e15fb2578072f18af8634fcfd85b61c22969d01272eb0"}
Jul 13 03:41:44.955131 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955106    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"c8036fee31ba0f062f3fe698a2f1b5d9466ea9fe26b3998971a050f158d228ab"}
Jul 13 03:41:44.955183 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955157    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"c3b9bd009227f756b97afabdac7b328cbb99e2858b46a3cba51e9fda53379ae9"}
Jul 13 03:41:44.955241 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955207    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"848cec01857a4e25de3e4a12fe5d7e6bf956a126e0137b5b971968c3b97b9e9f"}
Jul 13 03:41:44.955285 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955255    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerDied","Data":"4c089aa784491d12652cff41d32e93a741d20dbae3fb09a195a765acbda0322d"}
Jul 13 03:41:44.955323 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.955306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"e35c8d7c7452823f0b158370c67352039bbbd987c7fdae117218f252fa78ea8f"}
Jul 13 03:41:44.956587 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.956563    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="7a74a8355d4a37a89ac94a89fcd7fa3abb327a1a3a06ef88f914f7528998112e" exitCode=0
Jul 13 03:41:44.956709 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.956629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"7a74a8355d4a37a89ac94a89fcd7fa3abb327a1a3a06ef88f914f7528998112e"}
Jul 13 03:41:44.958263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.958241    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jxzll" event={"ID":"2b5e3585-8c4d-4b0b-89d9-0b1ab080a559","Type":"ContainerStarted","Data":"490c7f9a6a9376fc7d932ccc4f79e79924d1746b07736e0e2c3670846796029e"}
Jul 13 03:41:44.960058 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.960035    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rmchl" event={"ID":"5f382543-7683-4be0-9ec4-13235f17f452","Type":"ContainerStarted","Data":"307b1ebec2e6db8d7d5e41ca930f627adca29da625f394675edc161dd929cf00"}
Jul 13 03:41:44.961687 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.961669    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs" event={"ID":"06aba64f-5230-4113-aee1-20243a42537a","Type":"ContainerStarted","Data":"83836295a3c9098256367f11c393c3ae67a2e00040c8d9c9965c64ffefbe4e52"}
Jul 13 03:41:44.963224 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.963198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-b8f79" event={"ID":"90b58b40-a7cd-44a2-8671-7e82728cf5f5","Type":"ContainerStarted","Data":"8e398c2914d296622abf3ce70926d84ebb6389ac1226bf973ac89c027e6dfe88"}
Jul 13 03:41:44.967075 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.967028    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-187.ec2.internal" podStartSLOduration=21.967012191 podStartE2EDuration="21.967012191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:26.929734784 +0000 UTC m=+5.705449070" watchObservedRunningTime="2026-07-13 03:41:44.967012191 +0000 UTC m=+23.742726472"
Jul 13 03:41:44.967328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.967301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5jcsz" podStartSLOduration=7.530222128 podStartE2EDuration="22.967295219s" totalImagesPullingTime="15.437073091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:44.966488759 +0000 UTC m=+23.742203038" watchObservedRunningTime="2026-07-13 03:41:44.967295219 +0000 UTC m=+23.743009499"
Jul 13 03:41:44.982406 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.982351    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jxzll" podStartSLOduration=3.851975612 podStartE2EDuration="22.982330808s" totalImagesPullingTime="19.130355196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:44.981959232 +0000 UTC m=+23.757673513" watchObservedRunningTime="2026-07-13 03:41:44.982330808 +0000 UTC m=+23.758045089"
Jul 13 03:41:44.995956 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:44.995911    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xjbxn" podStartSLOduration=3.8993196980000002 podStartE2EDuration="22.995898693s" totalImagesPullingTime="19.096578995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:44.995341791 +0000 UTC m=+23.771056070" watchObservedRunningTime="2026-07-13 03:41:44.995898693 +0000 UTC m=+23.771613006"
Jul 13 03:41:45.008771 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.008712    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-b8f79" podStartSLOduration=3.899002508 podStartE2EDuration="23.008697516s" totalImagesPullingTime="19.109695008s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:45.00830647 +0000 UTC m=+23.784020750" watchObservedRunningTime="2026-07-13 03:41:45.008697516 +0000 UTC m=+23.784411796"
Jul 13 03:41:45.023786 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.023723    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rmchl" podStartSLOduration=3.858729883 podStartE2EDuration="23.02371069s" totalImagesPullingTime="19.164980807s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:45.023693646 +0000 UTC m=+23.799407919" watchObservedRunningTime="2026-07-13 03:41:45.02371069 +0000 UTC m=+23.799424969"
Jul 13 03:41:45.506461 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.506432    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 03:41:45.754964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.754891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:45.755190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.754891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:45.755190 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:45.755007    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:45.755190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.754891    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:45.755190 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:45.755065    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:45.755190 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:45.755171    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:45.762640 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.762563    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T03:41:45.50645478Z","UUID":"5ef2dd8b-6f43-48f5-9edb-730bb3364b4d","Handler":null,"Name":"","Endpoint":""}
Jul 13 03:41:45.763871 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.763855    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 03:41:45.763975 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.763887    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 03:41:45.876979 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.876943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:45.967270 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.967236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:45.969825 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.969795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs" event={"ID":"06aba64f-5230-4113-aee1-20243a42537a","Type":"ContainerStarted","Data":"e44552a5ff65515b2aea46c0cb40521c1b3fd21322408e0cd91142ca2e99f6b5"}
Jul 13 03:41:45.971575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.971547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zj4z6" event={"ID":"95c21b33-8864-44e3-a354-34ac91133951","Type":"ContainerStarted","Data":"bb114ca746ef3ccba407ba78247ff9fc67774a879c51b9fbc323715721f1837c"}
Jul 13 03:41:45.986057 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:45.986005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zj4z6" podStartSLOduration=4.880606552 podStartE2EDuration="23.985990941s" totalImagesPullingTime="19.105384389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:45.985405949 +0000 UTC m=+24.761120232" watchObservedRunningTime="2026-07-13 03:41:45.985990941 +0000 UTC m=+24.761705221"
Jul 13 03:41:46.045665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:46.045584    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:46.640086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:46.640029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:46.977574 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:46.977549    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:41:46.978107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:46.978074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"1ee79e2f467214307de3481bd3d3893b6bccafb3e40a098c455fbc463cb19321"}
Jul 13 03:41:46.980402 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:46.980356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs" event={"ID":"06aba64f-5230-4113-aee1-20243a42537a","Type":"ContainerStarted","Data":"2ab6c5afe0d02fc0fe175fc74db9b08cea8ac5adfc26fab9fbeb679ac39b5c07"}
Jul 13 03:41:47.004382 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.004316    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kn4xs" podStartSLOduration=3.835080337 podStartE2EDuration="25.004295544s" totalImagesPullingTime="21.169215207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:47.003474299 +0000 UTC m=+25.779188591" watchObservedRunningTime="2026-07-13 03:41:47.004295544 +0000 UTC m=+25.780009826"
Jul 13 03:41:47.054670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.054631    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:47.107626 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.107568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:47.740781 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.740750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:47.741559 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.741542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:47.755053 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.754941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:47.755053 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.754960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:47.755053 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:47.755038    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:47.755329 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:47.755109    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:47.755329 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.755142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:47.755329 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:47.755227    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:47.983015 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.982779    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:47.983432 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:47.983385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5jcsz"
Jul 13 03:41:48.038346 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:48.038260    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:49.754374 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.754347    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:49.755233 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.754357    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:49.755233 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:49.754464    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:49.755233 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.754488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:49.755233 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:49.754550    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:49.755233 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:49.754659    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:49.988499 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.988467    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="5e0147842187aa51dfa9eeb6c324e2b40300615799a40f4f8c3120fb40097c49" exitCode=0
Jul 13 03:41:49.988662 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.988536    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"5e0147842187aa51dfa9eeb6c324e2b40300615799a40f4f8c3120fb40097c49"}
Jul 13 03:41:49.995233 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.995212    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:41:49.995575 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.995554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"54f6a91aaf911ca65dcadacc99c0d0903c41aff10bec6f48c430e9a41fe2a3a6"}
Jul 13 03:41:49.995855 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.995834    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:49.995960 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.995898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:49.996027 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:49.996009    2582 scope.go:117] "RemoveContainer" containerID="4c089aa784491d12652cff41d32e93a741d20dbae3fb09a195a765acbda0322d"
Jul 13 03:41:50.012168 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:50.012147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:50.216236 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:50.216206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:50.418205 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:50.418172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:50.518541 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:50.518496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:51.002880 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.002854    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:41:51.003295 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.003236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" event={"ID":"f2d053e8-5c6a-4bc9-92da-eba0bf0f4809","Type":"ContainerStarted","Data":"62eb75586358856ad6fee01d5966f2a44fc62500e9d96596b002550bb4967986"}
Jul 13 03:41:51.003526 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.003505    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:51.018136 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.018110    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:41:51.028156 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.028113    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx" podStartSLOduration=9.829854187 podStartE2EDuration="29.028097825s" totalImagesPullingTime="19.198243638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:41:51.026977752 +0000 UTC m=+29.802692033" watchObservedRunningTime="2026-07-13 03:41:51.028097825 +0000 UTC m=+29.803812099"
Jul 13 03:41:51.532979 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.532879    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fks58"]
Jul 13 03:41:51.533162 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.533028    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:51.533162 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:51.533125    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:51.536158 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.536119    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zn6ft"]
Jul 13 03:41:51.536285 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.536263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:51.536390 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:51.536365    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:51.536708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.536687    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fmf2"]
Jul 13 03:41:51.536818 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:51.536804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:51.536911 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:51.536891    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:52.007894 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:52.007860    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="8fc6fbe3d2f4627d32a3e7ccd281d2b68e84acd80f5b1f8a4401604fe61f2158" exitCode=0
Jul 13 03:41:52.008357 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:52.007950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"8fc6fbe3d2f4627d32a3e7ccd281d2b68e84acd80f5b1f8a4401604fe61f2158"}
Jul 13 03:41:53.754454 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:53.754423    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:53.754833 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:53.754482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:53.754833 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:53.754488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:53.754833 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:53.754566    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:53.754833 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:53.754684    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:53.754833 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:53.754808    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:54.014482 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:54.014391    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="7cf567c7d72bfc49b600087b0c4e91ba46555bfe892dd1c2ad9c041a6f5f7cbb" exitCode=0
Jul 13 03:41:54.014482 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:54.014449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"7cf567c7d72bfc49b600087b0c4e91ba46555bfe892dd1c2ad9c041a6f5f7cbb"}
Jul 13 03:41:54.364337 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:54.364307    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:54.415177 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:54.415151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:55.531261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.531217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:55.531786 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.531307    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:55.531786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.531405    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:55.531786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.531452    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:55.531786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.531488    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs podName:5750286c-524f-47e3-a18f-3a4d6fef1c5b nodeName:}" failed. No retries permitted until 2026-07-13 03:42:27.531466274 +0000 UTC m=+66.307180534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs") pod "network-metrics-daemon-7fmf2" (UID: "5750286c-524f-47e3-a18f-3a4d6fef1c5b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 03:41:55.531786 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.531512    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret podName:1889e832-d11e-4813-85ce-c9472ecfa0a0 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:27.531495681 +0000 UTC m=+66.307209939 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret") pod "global-pull-secret-syncer-fks58" (UID: "1889e832-d11e-4813-85ce-c9472ecfa0a0") : object "kube-system"/"original-pull-secret" not registered
Jul 13 03:41:55.632090 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.632056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:55.632272 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.632242    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 03:41:55.632272 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.632266    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 03:41:55.632381 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.632279    2582 projected.go:196] Error preparing data for projected volume kube-api-access-tcl9p for pod openshift-network-diagnostics/network-check-target-zn6ft: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:55.632381 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.632349    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p podName:b05e482c-5ba2-46b3-9915-579c6aa4a945 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:27.632330284 +0000 UTC m=+66.408044561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tcl9p" (UniqueName: "kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p") pod "network-check-target-zn6ft" (UID: "b05e482c-5ba2-46b3-9915-579c6aa4a945") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 03:41:55.754044 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.754012    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:55.754044 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.754032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:55.754269 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:55.754013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:55.754553 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.754473    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:55.754775 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.754707    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:55.754882 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:55.754848    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:56.710176 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:56.710125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:56.861772 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:56.861722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:56.964105 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:56.964025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:57.058086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.058058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:57.158754 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.158686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:57.563749 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.563697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:57.664889 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.664860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:57.669104 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.669086    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8f79_90b58b40-a7cd-44a2-8671-7e82728cf5f5/dns-node-resolver/0.log"
Jul 13 03:41:57.754098 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.754049    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:57.754645 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.754050    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:57.754645 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:57.754182    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:57.754645 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:57.754180    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zn6ft" podUID="b05e482c-5ba2-46b3-9915-579c6aa4a945"
Jul 13 03:41:57.754645 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:57.754304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fmf2" podUID="5750286c-524f-47e3-a18f-3a4d6fef1c5b"
Jul 13 03:41:57.754645 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:57.754399    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fks58" podUID="1889e832-d11e-4813-85ce-c9472ecfa0a0"
Jul 13 03:41:58.006670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.006640    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-187.ec2.internal" event="NodeReady"
Jul 13 03:41:58.006875 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.006829    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 03:41:58.024379 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.024347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:58.039139 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.039111    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:41:58.041964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.041935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.045650 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.045625    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 03:41:58.046042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.046005    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 03:41:58.046042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.046031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qj9qk\""
Jul 13 03:41:58.046176 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.046075    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 03:41:58.052479 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.052443    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kdf55"]
Jul 13 03:41:58.053484 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.053459    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 03:41:58.056282 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.055900    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.057544 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.057524    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-j577x"]
Jul 13 03:41:58.060192 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.060170    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 03:41:58.060292 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.060176    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 03:41:58.060386 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.060366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tj96r\""
Jul 13 03:41:58.060386 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.060366    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 03:41:58.061170 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.061149    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:41:58.061295 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.061275    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.063446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.063426    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 03:41:58.063560 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.063545    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 03:41:58.063621 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.063589    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 03:41:58.063788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.063763    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5zfx\""
Jul 13 03:41:58.063921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.063904    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 03:41:58.066175 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.066155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kdf55"]
Jul 13 03:41:58.072237 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.071768    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j577x"]
Jul 13 03:41:58.077107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.077091    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-whw4z"]
Jul 13 03:41:58.079059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.079039    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.081372 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.081347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gjttq\""
Jul 13 03:41:58.081478 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.081349    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 03:41:58.081478 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.081435    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 03:41:58.089659 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.089641    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whw4z"]
Jul 13 03:41:58.111190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.111163    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:58.147669 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147636    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qczbb\" (UniqueName: \"kubernetes.io/projected/c148312f-d974-4424-a520-e6af34346644-kube-api-access-qczbb\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.147669 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147665    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ecd1bc-f07d-417c-87ef-3a58e8992138-data-volume\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.147892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27b4f\" (UniqueName: \"kubernetes.io/projected/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-kube-api-access-27b4f\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.147892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.147892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147852    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c148312f-d974-4424-a520-e6af34346644-config-volume\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.147892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7tx\" (UniqueName: \"kubernetes.io/projected/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-api-access-mc7tx\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.147999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1ecd1bc-f07d-417c-87ef-3a58e8992138-crio-socket\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c148312f-d974-4424-a520-e6af34346644-tmp-dir\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148117    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-cert\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.148388 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.148251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk29b\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.187670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.187651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:58.249332 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27b4f\" (UniqueName: \"kubernetes.io/projected/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-kube-api-access-27b4f\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.249439 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.249498 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.249456    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 03:41:58.249551 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c148312f-d974-4424-a520-e6af34346644-config-volume\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.249551 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.249511    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls podName:c148312f-d974-4424-a520-e6af34346644 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.749492865 +0000 UTC m=+37.525207129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls") pod "dns-default-whw4z" (UID: "c148312f-d974-4424-a520-e6af34346644") : secret "dns-default-metrics-tls" not found
Jul 13 03:41:58.249551 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.249707 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.249707 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.249707 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.249707 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249688    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7tx\" (UniqueName: \"kubernetes.io/projected/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-api-access-mc7tx\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1ecd1bc-f07d-417c-87ef-3a58e8992138-crio-socket\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.249826    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c148312f-d974-4424-a520-e6af34346644-tmp-dir\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.249920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.249928    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.749907611 +0000 UTC m=+37.525621886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.249995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250000    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1ecd1bc-f07d-417c-87ef-3a58e8992138-crio-socket\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250104    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c148312f-d974-4424-a520-e6af34346644-config-volume\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.250186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-cert\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk29b\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c148312f-d974-4424-a520-e6af34346644-tmp-dir\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250295    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qczbb\" (UniqueName: \"kubernetes.io/projected/c148312f-d974-4424-a520-e6af34346644-kube-api-access-qczbb\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ecd1bc-f07d-417c-87ef-3a58e8992138-data-volume\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.250327    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.250378    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f447dc86-88w6k: secret "image-registry-tls" not found
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.250427    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls podName:8b88b435-7635-487b-b524-1475bfbe45cb nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.750413501 +0000 UTC m=+37.526127773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls") pod "image-registry-58f447dc86-88w6k" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb") : secret "image-registry-tls" not found
Jul 13 03:41:58.250471 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.250464    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:41:58.250940 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.250528    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:58.750513205 +0000 UTC m=+37.526227483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : configmap "kube-rbac-proxy" not found
Jul 13 03:41:58.250940 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1ecd1bc-f07d-417c-87ef-3a58e8992138-data-volume\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.250940 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.250920    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.253806 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.253788    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.253947 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.253928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.253992 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.253956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-cert\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.260712 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.260631    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7tx\" (UniqueName: \"kubernetes.io/projected/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-api-access-mc7tx\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.260712 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.260655    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.260883 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.260802    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27b4f\" (UniqueName: \"kubernetes.io/projected/f56d0347-7f5b-4fc5-b1d8-9bb38580f906-kube-api-access-27b4f\") pod \"ingress-canary-kdf55\" (UID: \"f56d0347-7f5b-4fc5-b1d8-9bb38580f906\") " pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.262496 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.262473    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk29b\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.262788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.262720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qczbb\" (UniqueName: \"kubernetes.io/projected/c148312f-d974-4424-a520-e6af34346644-kube-api-access-qczbb\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.285785 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.285754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:58.368610 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.368588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kdf55"
Jul 13 03:41:58.493149 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.492980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kdf55"]
Jul 13 03:41:58.496144 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:58.496118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56d0347_7f5b_4fc5_b1d8_9bb38580f906.slice/crio-dc4d88708c20050ce2046ca0fb6605378a4a26e8d7711e946a802c68a4a71791 WatchSource:0}: Error finding container dc4d88708c20050ce2046ca0fb6605378a4a26e8d7711e946a802c68a4a71791: Status 404 returned error can't find the container with id dc4d88708c20050ce2046ca0fb6605378a4a26e8d7711e946a802c68a4a71791
Jul 13 03:41:58.754836 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.754806    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.754852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.754947    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.754958    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.754993    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:59.754980761 +0000 UTC m=+38.530695018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.755018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755060    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:58.755095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755104    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:59.755091888 +0000 UTC m=+38.530806146 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : configmap "kube-rbac-proxy" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755132    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls podName:c148312f-d974-4424-a520-e6af34346644 nodeName:}" failed. No retries permitted until 2026-07-13 03:41:59.755116899 +0000 UTC m=+38.530831169 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls") pod "dns-default-whw4z" (UID: "c148312f-d974-4424-a520-e6af34346644") : secret "dns-default-metrics-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755173    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755190    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f447dc86-88w6k: secret "image-registry-tls" not found
Jul 13 03:41:58.755443 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:58.755235    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls podName:8b88b435-7635-487b-b524-1475bfbe45cb nodeName:}" failed. No retries permitted until 2026-07-13 03:41:59.75522212 +0000 UTC m=+38.530936402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls") pod "image-registry-58f447dc86-88w6k" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb") : secret "image-registry-tls" not found
Jul 13 03:41:59.029223 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.029137    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="6efd9628432652f260a315dc176e9f3efb14eb393083136a9266a988e4246c6e" exitCode=0
Jul 13 03:41:59.029223 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.029176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"6efd9628432652f260a315dc176e9f3efb14eb393083136a9266a988e4246c6e"}
Jul 13 03:41:59.029429 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.029152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:59.031115 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.030576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kdf55" event={"ID":"f56d0347-7f5b-4fc5-b1d8-9bb38580f906","Type":"ContainerStarted","Data":"dc4d88708c20050ce2046ca0fb6605378a4a26e8d7711e946a802c68a4a71791"}
Jul 13 03:41:59.069251 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.069162    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjbxn_59dde4e2-5c97-4c8a-b822-12010aebafa2/node-ca/0.log"
Jul 13 03:41:59.128606 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.128574    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:59.160391 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.160369    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2bdkk"]
Jul 13 03:41:59.162825 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.162795    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.165271 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.165243    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 13 03:41:59.165271 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.165262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 13 03:41:59.165441 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.165318    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6vxkq\""
Jul 13 03:41:59.165441 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.165325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 13 03:41:59.165441 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.165263    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 13 03:41:59.172971 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.172951    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2bdkk"]
Jul 13 03:41:59.194091 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.194054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:59.258690 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.258659    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/591fc429-6e90-42fe-801e-cecea624868d-signing-key\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.258690 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.258690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/591fc429-6e90-42fe-801e-cecea624868d-signing-cabundle\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.258904 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.258767    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp757\" (UniqueName: \"kubernetes.io/projected/591fc429-6e90-42fe-801e-cecea624868d-kube-api-access-rp757\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.263580 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.263550    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:59.359939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.359901    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/591fc429-6e90-42fe-801e-cecea624868d-signing-key\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.359939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.359942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/591fc429-6e90-42fe-801e-cecea624868d-signing-cabundle\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.360181 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.360054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp757\" (UniqueName: \"kubernetes.io/projected/591fc429-6e90-42fe-801e-cecea624868d-kube-api-access-rp757\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.360681 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.360651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/591fc429-6e90-42fe-801e-cecea624868d-signing-cabundle\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.364088 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.364051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:41:59.364353 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.364331    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/591fc429-6e90-42fe-801e-cecea624868d-signing-key\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.368537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.368513    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp757\" (UniqueName: \"kubernetes.io/projected/591fc429-6e90-42fe-801e-cecea624868d-kube-api-access-rp757\") pod \"service-ca-79f68b9f4f-2bdkk\" (UID: \"591fc429-6e90-42fe-801e-cecea624868d\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.509460 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.509425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk"
Jul 13 03:41:59.647769 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.647666    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2bdkk"]
Jul 13 03:41:59.652749 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:41:59.652708    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591fc429_6e90_42fe_801e_cecea624868d.slice/crio-047a4d21e21fd85b1f0d54fa24352f44e8392a3790e04a7e426841e128bb5d1f WatchSource:0}: Error finding container 047a4d21e21fd85b1f0d54fa24352f44e8392a3790e04a7e426841e128bb5d1f: Status 404 returned error can't find the container with id 047a4d21e21fd85b1f0d54fa24352f44e8392a3790e04a7e426841e128bb5d1f
Jul 13 03:41:59.754523 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.754489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:41:59.754683 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.754489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:41:59.754683 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.754634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:41:59.756943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.756865    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 03:41:59.757338 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.757145    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx94t\""
Jul 13 03:41:59.757403 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.757380    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 03:41:59.757450 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.757384    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc8qt\""
Jul 13 03:41:59.757762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.757722    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 03:41:59.757762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.757748    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 03:41:59.764043 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.764018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:41:59.764138 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.764083    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:41:59.764198 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.764141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:59.764198 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:41:59.764186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:41:59.764321 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764208    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 03:41:59.764321 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764254    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls podName:c148312f-d974-4424-a520-e6af34346644 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.764241282 +0000 UTC m=+40.539955540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls") pod "dns-default-whw4z" (UID: "c148312f-d974-4424-a520-e6af34346644") : secret "dns-default-metrics-tls" not found
Jul 13 03:41:59.764321 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764304    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764350    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.764335254 +0000 UTC m=+40.540049513 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : configmap "kube-rbac-proxy" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764371    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764384    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f447dc86-88w6k: secret "image-registry-tls" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764410    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764422    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls podName:8b88b435-7635-487b-b524-1475bfbe45cb nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.764409217 +0000 UTC m=+40.540123498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls") pod "image-registry-58f447dc86-88w6k" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb") : secret "image-registry-tls" not found
Jul 13 03:41:59.764469 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:41:59.764443    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:01.764433069 +0000 UTC m=+40.540147327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:00.033459 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:00.033379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk" event={"ID":"591fc429-6e90-42fe-801e-cecea624868d","Type":"ContainerStarted","Data":"047a4d21e21fd85b1f0d54fa24352f44e8392a3790e04a7e426841e128bb5d1f"}
Jul 13 03:42:00.036540 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:00.036513    2582 generic.go:356] "Generic (PLEG): container finished" podID="6b6e5938-52d8-4c7f-966c-0c1889b2fd7e" containerID="26646929d2d514b3a93e299c77a24068bdd726809b8da7b8c468bec361949cf5" exitCode=0
Jul 13 03:42:00.036672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:00.036559    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerDied","Data":"26646929d2d514b3a93e299c77a24068bdd726809b8da7b8c468bec361949cf5"}
Jul 13 03:42:00.245475 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:00.245243    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:01.041456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.041413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sllkc" event={"ID":"6b6e5938-52d8-4c7f-966c-0c1889b2fd7e","Type":"ContainerStarted","Data":"88a96cb1ea112dc470d3be306080784e06017ddac6025bbca4bec335d5485a09"}
Jul 13 03:42:01.075179 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.075122    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sllkc" podStartSLOduration=8.825861284 podStartE2EDuration="39.075102066s" totalImagesPullingTime="30.249240782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:01.074169733 +0000 UTC m=+39.849884012" watchObservedRunningTime="2026-07-13 03:42:01.075102066 +0000 UTC m=+39.850816349"
Jul 13 03:42:01.487305 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.487268    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:01.587303 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.587267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:01.783929 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.783856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:01.783929 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.783902    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.783935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:01.783962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784003    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784028    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f447dc86-88w6k: secret "image-registry-tls" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784033    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784046    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784075    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:05.784062702 +0000 UTC m=+44.559776960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : configmap "kube-rbac-proxy" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784003    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784088    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls podName:8b88b435-7635-487b-b524-1475bfbe45cb nodeName:}" failed. No retries permitted until 2026-07-13 03:42:05.784082107 +0000 UTC m=+44.559796365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls") pod "image-registry-58f447dc86-88w6k" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb") : secret "image-registry-tls" not found
Jul 13 03:42:01.784097 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784100    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:05.784094966 +0000 UTC m=+44.559809224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:01.784392 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:01.784113    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls podName:c148312f-d974-4424-a520-e6af34346644 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:05.784108851 +0000 UTC m=+44.559823109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls") pod "dns-default-whw4z" (UID: "c148312f-d974-4424-a520-e6af34346644") : secret "dns-default-metrics-tls" not found
Jul 13 03:42:02.045218 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:02.045140    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kdf55" event={"ID":"f56d0347-7f5b-4fc5-b1d8-9bb38580f906","Type":"ContainerStarted","Data":"4185bf4581e5b6c48e3807eac2e037062eabbd10848e2996203cd43292e96b8c"}
Jul 13 03:42:02.061922 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:02.061873    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kdf55" podStartSLOduration=1.4015584890000001 podStartE2EDuration="4.061858105s" totalImagesPullingTime="2.660299616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:02.060744222 +0000 UTC m=+40.836458502" watchObservedRunningTime="2026-07-13 03:42:02.061858105 +0000 UTC m=+40.837572384"
Jul 13 03:42:03.051305 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:03.050092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk" event={"ID":"591fc429-6e90-42fe-801e-cecea624868d","Type":"ContainerStarted","Data":"2401be65688984a085da9ea46f90dc353eb733b43775ccf686617bb1f76210a3"}
Jul 13 03:42:03.067245 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:03.067195    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-2bdkk" podStartSLOduration=1.5502011740000001 podStartE2EDuration="4.067180079s" totalImagesPullingTime="2.516978905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:03.06583488 +0000 UTC m=+41.841549162" watchObservedRunningTime="2026-07-13 03:42:03.067180079 +0000 UTC m=+41.842894395"
Jul 13 03:42:03.331425 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:03.331386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:03.801762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:03.801666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:03.901692 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:03.901658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:04.012314 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:04.012277    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:04.112943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:04.112909    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:04.214035 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:04.213999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:04.328631 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:04.328589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:04.456426 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:04.456314    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:05.253356 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.253322    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:05.656978 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.656940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:05.816288 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.816259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.816314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.816355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.816384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816394    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816414    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58f447dc86-88w6k: secret "image-registry-tls" not found
Jul 13 03:42:05.816457 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816455    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816473    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls podName:8b88b435-7635-487b-b524-1475bfbe45cb nodeName:}" failed. No retries permitted until 2026-07-13 03:42:13.816453018 +0000 UTC m=+52.592167280 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls") pod "image-registry-58f447dc86-88w6k" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb") : secret "image-registry-tls" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816478    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816478    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816503    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:13.816487904 +0000 UTC m=+52.592202184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : configmap "kube-rbac-proxy" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816578    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:13.816557999 +0000 UTC m=+52.592272265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:05.816709 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:05.816649    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls podName:c148312f-d974-4424-a520-e6af34346644 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:13.816636335 +0000 UTC m=+52.592350597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls") pod "dns-default-whw4z" (UID: "c148312f-d974-4424-a520-e6af34346644") : secret "dns-default-metrics-tls" not found
Jul 13 03:42:05.849252 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:05.849218    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:06.257773 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:06.257724    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:06.626820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:06.626770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:07.058629 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:07.058583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:07.456164 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:07.456068    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:07.509393 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:07.509351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:07.660961 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:07.660873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:07.851299 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:07.851267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:08.055041 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:08.055003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:08.102866 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:08.102787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:09.254420 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:09.254362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:09.452082 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:09.452044    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:09.642274 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:09.642234    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:09.743067 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:09.743025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:09.856333 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:09.856303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:10.051309 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:10.051214    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:10.517141 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:10.517106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:11.255168 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:11.255136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:11.461275 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:11.461248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:11.654708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:11.654672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:11.858683 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:11.858655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:12.053061 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:12.052981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:12.854900 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:12.854866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:12.997963 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:12.997934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:13.098418 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.098384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:13.253788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.253702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:13.655630 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.655589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:13.852275 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.852244    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:13.879870 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.879833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:13.880211 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.879897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:13.880211 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.879929    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:13.880211 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.879965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:13.880211 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:13.880063    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:13.880211 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:13.880142    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls podName:b1ecd1bc-f07d-417c-87ef-3a58e8992138 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:29.880123463 +0000 UTC m=+68.655837722 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls") pod "insights-runtime-extractor-j577x" (UID: "b1ecd1bc-f07d-417c-87ef-3a58e8992138") : secret "insights-runtime-extractor-tls" not found
Jul 13 03:42:13.880375 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.880337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1ecd1bc-f07d-417c-87ef-3a58e8992138-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:13.883178 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.883144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c148312f-d974-4424-a520-e6af34346644-metrics-tls\") pod \"dns-default-whw4z\" (UID: \"c148312f-d974-4424-a520-e6af34346644\") " pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:13.883314 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.883222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"image-registry-58f447dc86-88w6k\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") " pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:13.954796 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.954687    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:13.988036 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:13.988007    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:14.121842 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:14.121797    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:42:14.125618 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:14.125584    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b88b435_7635_487b_b524_1475bfbe45cb.slice/crio-80b845998b389573c7e3cb9ab70044247ab59f2062e66869abfa42daf8f9a592 WatchSource:0}: Error finding container 80b845998b389573c7e3cb9ab70044247ab59f2062e66869abfa42daf8f9a592: Status 404 returned error can't find the container with id 80b845998b389573c7e3cb9ab70044247ab59f2062e66869abfa42daf8f9a592
Jul 13 03:42:14.167753 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:14.167701    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-whw4z"]
Jul 13 03:42:14.170975 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:14.170949    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc148312f_d974_4424_a520_e6af34346644.slice/crio-d4b66d59ef2a4604753f41aba124535187fe0cefe28fca0df7d96428d92e5104 WatchSource:0}: Error finding container d4b66d59ef2a4604753f41aba124535187fe0cefe28fca0df7d96428d92e5104: Status 404 returned error can't find the container with id d4b66d59ef2a4604753f41aba124535187fe0cefe28fca0df7d96428d92e5104
Jul 13 03:42:14.255795 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:14.255747    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:14.451569 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:14.451535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:15.107194 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:15.107151    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" event={"ID":"8b88b435-7635-487b-b524-1475bfbe45cb","Type":"ContainerStarted","Data":"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"}
Jul 13 03:42:15.107665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:15.107221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" event={"ID":"8b88b435-7635-487b-b524-1475bfbe45cb","Type":"ContainerStarted","Data":"80b845998b389573c7e3cb9ab70044247ab59f2062e66869abfa42daf8f9a592"}
Jul 13 03:42:15.107665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:15.107245    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:15.108444 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:15.108422    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whw4z" event={"ID":"c148312f-d974-4424-a520-e6af34346644","Type":"ContainerStarted","Data":"d4b66d59ef2a4604753f41aba124535187fe0cefe28fca0df7d96428d92e5104"}
Jul 13 03:42:15.126236 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:15.126168    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" podStartSLOduration=46.126145341 podStartE2EDuration="46.126145341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:15.125918503 +0000 UTC m=+53.901632786" watchObservedRunningTime="2026-07-13 03:42:15.126145341 +0000 UTC m=+53.901859622"
Jul 13 03:42:17.116915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:17.116876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whw4z" event={"ID":"c148312f-d974-4424-a520-e6af34346644","Type":"ContainerStarted","Data":"52ccf595a20ed6344f096d52d152f2bf64103dcf9f07799cd25af3dde82b94a3"}
Jul 13 03:42:17.117300 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:17.116972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-whw4z" event={"ID":"c148312f-d974-4424-a520-e6af34346644","Type":"ContainerStarted","Data":"b31793f25ac73e586c914dc643e4226a12073cbaa9d902cac418362052e20964"}
Jul 13 03:42:17.117300 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:17.117032    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:17.133317 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:17.133271    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-whw4z" podStartSLOduration=16.927614992 podStartE2EDuration="19.133255758s" totalImagesPullingTime="2.205640766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:17.131850301 +0000 UTC m=+55.907564580" watchObservedRunningTime="2026-07-13 03:42:17.133255758 +0000 UTC m=+55.908970037"
Jul 13 03:42:21.830399 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:21.830367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:21.881254 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:21.881223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:21.932075 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:21.932049    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.221683 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.221586    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.259178 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.259149    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"]
Jul 13 03:42:22.268097 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.268069    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"]
Jul 13 03:42:22.268263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.268188    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.270812 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.270792    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 13 03:42:22.270926 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.270831    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 13 03:42:22.271655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.271637    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 13 03:42:22.271765 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.271638    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 13 03:42:22.273431 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.273410    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.276386 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.276365    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 13 03:42:22.279422 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.279399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"]
Jul 13 03:42:22.286472 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.286451    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 13 03:42:22.287007 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.286990    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 13 03:42:22.287879 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.287860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 13 03:42:22.290299 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.290277    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"]
Jul 13 03:42:22.326661 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.326623    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:42:22.350489 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn8hf\" (UniqueName: \"kubernetes.io/projected/38885313-c91a-489d-a603-fba5c1ce6fc9-kube-api-access-dn8hf\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.350489 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.350767 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350577    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38885313-c91a-489d-a603-fba5c1ce6fc9-tmp\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.350767 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350629    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.350767 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38885313-c91a-489d-a603-fba5c1ce6fc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.350767 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350686    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7825d01-a8e5-432b-91d0-4116ce41f3f1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.350767 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350706    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.350986 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350810    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.350986 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.350861    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s66t\" (UniqueName: \"kubernetes.io/projected/c7825d01-a8e5-432b-91d0-4116ce41f3f1-kube-api-access-6s66t\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.353180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.353157    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-kbx4w"]
Jul 13 03:42:22.356853 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.356827    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:22.359316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.359293    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 03:42:22.359442 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.359426    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 03:42:22.359623 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.359602    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kcsk7\""
Jul 13 03:42:22.365881 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.365860    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kbx4w"]
Jul 13 03:42:22.368127 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.368104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.444910 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.444873    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55dcb6bb67-p52v5"]
Jul 13 03:42:22.447987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.447970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.451547 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8hf\" (UniqueName: \"kubernetes.io/projected/38885313-c91a-489d-a603-fba5c1ce6fc9-kube-api-access-dn8hf\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.451637 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451585    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.451637 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38885313-c91a-489d-a603-fba5c1ce6fc9-tmp\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.451761 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451655    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.451817 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38885313-c91a-489d-a603-fba5c1ce6fc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.451817 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7825d01-a8e5-432b-91d0-4116ce41f3f1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.451915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lskhb\" (UniqueName: \"kubernetes.io/projected/e9f03bcb-8d30-4256-b41f-25de126a9f30-kube-api-access-lskhb\") pod \"downloads-68c9cbb497-kbx4w\" (UID: \"e9f03bcb-8d30-4256-b41f-25de126a9f30\") " pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:22.451915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.451863    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.452138 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.452114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38885313-c91a-489d-a603-fba5c1ce6fc9-tmp\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.452211 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.452140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.452211 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.452194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s66t\" (UniqueName: \"kubernetes.io/projected/c7825d01-a8e5-432b-91d0-4116ce41f3f1-kube-api-access-6s66t\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.452477 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.452451    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7825d01-a8e5-432b-91d0-4116ce41f3f1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.453981 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.453854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.454777 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.454757    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.454921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.454783    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-ca\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.454921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.454829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-hub\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.455046 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.454977    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c7825d01-a8e5-432b-91d0-4116ce41f3f1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.455214 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.455062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/38885313-c91a-489d-a603-fba5c1ce6fc9-klusterlet-config\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.463003 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.462980    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55dcb6bb67-p52v5"]
Jul 13 03:42:22.466501 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.466474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s66t\" (UniqueName: \"kubernetes.io/projected/c7825d01-a8e5-432b-91d0-4116ce41f3f1-kube-api-access-6s66t\") pod \"cluster-proxy-proxy-agent-fd8c7b74c-ggpb7\" (UID: \"c7825d01-a8e5-432b-91d0-4116ce41f3f1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.466775 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.466715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn8hf\" (UniqueName: \"kubernetes.io/projected/38885313-c91a-489d-a603-fba5c1ce6fc9-kube-api-access-dn8hf\") pod \"klusterlet-addon-workmgr-84844d9ccb-2nr8v\" (UID: \"38885313-c91a-489d-a603-fba5c1ce6fc9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.548131 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.548059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.553205 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-registry-tls\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hlv2\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-kube-api-access-7hlv2\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-image-registry-private-configuration\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553384 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553301    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lskhb\" (UniqueName: \"kubernetes.io/projected/e9f03bcb-8d30-4256-b41f-25de126a9f30-kube-api-access-lskhb\") pod \"downloads-68c9cbb497-kbx4w\" (UID: \"e9f03bcb-8d30-4256-b41f-25de126a9f30\") " pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:22.553384 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553352    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-bound-sa-token\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-trusted-ca\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-registry-certificates\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-installation-pull-secrets\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.553531 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.553465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606b922e-ed09-456a-87a2-891454e4d0a7-ca-trust-extracted\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.562988 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.562963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lskhb\" (UniqueName: \"kubernetes.io/projected/e9f03bcb-8d30-4256-b41f-25de126a9f30-kube-api-access-lskhb\") pod \"downloads-68c9cbb497-kbx4w\" (UID: \"e9f03bcb-8d30-4256-b41f-25de126a9f30\") " pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:22.576884 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.576857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:22.598922 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.598892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"
Jul 13 03:42:22.648180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.648105    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.654137 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.654105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-bound-sa-token\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.654599 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.654572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-trusted-ca\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.655714 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.655685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-trusted-ca\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656049 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656020    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-registry-certificates\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656082    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-installation-pull-secrets\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656187 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606b922e-ed09-456a-87a2-891454e4d0a7-ca-trust-extracted\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656187 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/606b922e-ed09-456a-87a2-891454e4d0a7-registry-certificates\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656290 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656185    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-registry-tls\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656290 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hlv2\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-kube-api-access-7hlv2\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656290 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-image-registry-private-configuration\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.656796 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.656519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/606b922e-ed09-456a-87a2-891454e4d0a7-ca-trust-extracted\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.658995 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.658952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-image-registry-private-configuration\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.659126 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.659103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-registry-tls\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.659259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.659199    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/606b922e-ed09-456a-87a2-891454e4d0a7-installation-pull-secrets\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.665166 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.665117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hlv2\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-kube-api-access-7hlv2\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.665939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.665516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:22.666112 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.666057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/606b922e-ed09-456a-87a2-891454e4d0a7-bound-sa-token\") pod \"image-registry-55dcb6bb67-p52v5\" (UID: \"606b922e-ed09-456a-87a2-891454e4d0a7\") " pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.737839 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.737804    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"]
Jul 13 03:42:22.742296 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:22.742255    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38885313_c91a_489d_a603_fba5c1ce6fc9.slice/crio-560c3c722a014f66d0080b77fa80ab5b6d17d62f0fe7d95aa4f764bb4827627b WatchSource:0}: Error finding container 560c3c722a014f66d0080b77fa80ab5b6d17d62f0fe7d95aa4f764bb4827627b: Status 404 returned error can't find the container with id 560c3c722a014f66d0080b77fa80ab5b6d17d62f0fe7d95aa4f764bb4827627b
Jul 13 03:42:22.765309 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.765251    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7"]
Jul 13 03:42:22.765480 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.765362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:22.768596 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:22.768565    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7825d01_a8e5_432b_91d0_4116ce41f3f1.slice/crio-46bd8b68f6ef14885e3bc3227067ec9e67dbc74a1e9c107b9b3a720c2bf2549d WatchSource:0}: Error finding container 46bd8b68f6ef14885e3bc3227067ec9e67dbc74a1e9c107b9b3a720c2bf2549d: Status 404 returned error can't find the container with id 46bd8b68f6ef14885e3bc3227067ec9e67dbc74a1e9c107b9b3a720c2bf2549d
Jul 13 03:42:22.827879 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.827849    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-kbx4w"]
Jul 13 03:42:22.830647 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:22.830624    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f03bcb_8d30_4256_b41f_25de126a9f30.slice/crio-ee7c2edf7e44bf23dca077f9641fa28ae14c9848894bf58645133ea7e8760ece WatchSource:0}: Error finding container ee7c2edf7e44bf23dca077f9641fa28ae14c9848894bf58645133ea7e8760ece: Status 404 returned error can't find the container with id ee7c2edf7e44bf23dca077f9641fa28ae14c9848894bf58645133ea7e8760ece
Jul 13 03:42:22.926915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.926851    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55dcb6bb67-p52v5"]
Jul 13 03:42:22.927093 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:22.926957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:22.930033 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:22.930002    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod606b922e_ed09_456a_87a2_891454e4d0a7.slice/crio-59818b326b074c37a9593c48eb20eaa0d68414a5fdc5aaa528dd21227cfa6171 WatchSource:0}: Error finding container 59818b326b074c37a9593c48eb20eaa0d68414a5fdc5aaa528dd21227cfa6171: Status 404 returned error can't find the container with id 59818b326b074c37a9593c48eb20eaa0d68414a5fdc5aaa528dd21227cfa6171
Jul 13 03:42:23.029528 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.029497    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rx4gx"
Jul 13 03:42:23.137111 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.137071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5" event={"ID":"606b922e-ed09-456a-87a2-891454e4d0a7","Type":"ContainerStarted","Data":"6d7ddbadd06a273102f4df38718b8373e5a2840a374ffea85e7a5942e26fdd44"}
Jul 13 03:42:23.137315 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.137130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5" event={"ID":"606b922e-ed09-456a-87a2-891454e4d0a7","Type":"ContainerStarted","Data":"59818b326b074c37a9593c48eb20eaa0d68414a5fdc5aaa528dd21227cfa6171"}
Jul 13 03:42:23.137315 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.137187    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:23.138373 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.138349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v" event={"ID":"38885313-c91a-489d-a603-fba5c1ce6fc9","Type":"ContainerStarted","Data":"560c3c722a014f66d0080b77fa80ab5b6d17d62f0fe7d95aa4f764bb4827627b"}
Jul 13 03:42:23.139385 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.139357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7" event={"ID":"c7825d01-a8e5-432b-91d0-4116ce41f3f1","Type":"ContainerStarted","Data":"46bd8b68f6ef14885e3bc3227067ec9e67dbc74a1e9c107b9b3a720c2bf2549d"}
Jul 13 03:42:23.140560 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.140530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kbx4w" event={"ID":"e9f03bcb-8d30-4256-b41f-25de126a9f30","Type":"ContainerStarted","Data":"ee7c2edf7e44bf23dca077f9641fa28ae14c9848894bf58645133ea7e8760ece"}
Jul 13 03:42:23.155089 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.155044    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5" podStartSLOduration=1.155026305 podStartE2EDuration="1.155026305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:23.154445401 +0000 UTC m=+61.930159682" watchObservedRunningTime="2026-07-13 03:42:23.155026305 +0000 UTC m=+61.930740564"
Jul 13 03:42:23.166382 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.166338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.227693 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.227659    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.328887 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.328835    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.382134 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.382098    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.526655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.526572    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.634606 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.634512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.736712 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.736669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:23.834932 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:23.834852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.040527 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.040480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.139298 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.139202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.214369 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.214332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.635419 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.635276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.735548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.735510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:24.788917 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:24.788830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:25.034487 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:25.034309    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:25.094244 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:25.094188    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:27.122688 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.122654    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-whw4z"
Jul 13 03:42:27.605119 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.605076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:42:27.605305 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.605204    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:42:27.607915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.607892    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 03:42:27.608052 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.607956    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 03:42:27.618603 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.618581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5750286c-524f-47e3-a18f-3a4d6fef1c5b-metrics-certs\") pod \"network-metrics-daemon-7fmf2\" (UID: \"5750286c-524f-47e3-a18f-3a4d6fef1c5b\") " pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:42:27.619047 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.619009    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1889e832-d11e-4813-85ce-c9472ecfa0a0-original-pull-secret\") pod \"global-pull-secret-syncer-fks58\" (UID: \"1889e832-d11e-4813-85ce-c9472ecfa0a0\") " pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:42:27.669053 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.668906    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx94t\""
Jul 13 03:42:27.677131 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.676975    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fmf2"
Jul 13 03:42:27.677131 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.677029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fks58"
Jul 13 03:42:27.706420 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.706390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:42:27.708928 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.708903    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 03:42:27.719929 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.719899    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 03:42:27.730839 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.730806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl9p\" (UniqueName: \"kubernetes.io/projected/b05e482c-5ba2-46b3-9915-579c6aa4a945-kube-api-access-tcl9p\") pod \"network-check-target-zn6ft\" (UID: \"b05e482c-5ba2-46b3-9915-579c6aa4a945\") " pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:42:27.974824 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.974719    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vc8qt\""
Jul 13 03:42:27.982399 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:27.982358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:42:28.695153 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:28.695104    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:28.748623 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:28.748591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:29.329920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:29.329090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zn6ft"]
Jul 13 03:42:29.336000 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:29.335967    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05e482c_5ba2_46b3_9915_579c6aa4a945.slice/crio-04537a8862c4c77aca12acba209ebb551470de6db3124e4d906e4d025036b4f4 WatchSource:0}: Error finding container 04537a8862c4c77aca12acba209ebb551470de6db3124e4d906e4d025036b4f4: Status 404 returned error can't find the container with id 04537a8862c4c77aca12acba209ebb551470de6db3124e4d906e4d025036b4f4
Jul 13 03:42:29.342247 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:29.342223    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fmf2"]
Jul 13 03:42:29.348694 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:29.348551    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5750286c_524f_47e3_a18f_3a4d6fef1c5b.slice/crio-c6826c88ee32316f3f151102b1d9a6ce1568b2cbf9eaacaca6f6e3abf6af048b WatchSource:0}: Error finding container c6826c88ee32316f3f151102b1d9a6ce1568b2cbf9eaacaca6f6e3abf6af048b: Status 404 returned error can't find the container with id c6826c88ee32316f3f151102b1d9a6ce1568b2cbf9eaacaca6f6e3abf6af048b
Jul 13 03:42:29.355189 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:29.355138    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fks58"]
Jul 13 03:42:29.357908 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:29.357878    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1889e832_d11e_4813_85ce_c9472ecfa0a0.slice/crio-ec4d52689f390e015bab74e9151f3fa4147213ffb3d82ab9a122d5b9bab407e6 WatchSource:0}: Error finding container ec4d52689f390e015bab74e9151f3fa4147213ffb3d82ab9a122d5b9bab407e6: Status 404 returned error can't find the container with id ec4d52689f390e015bab74e9151f3fa4147213ffb3d82ab9a122d5b9bab407e6
Jul 13 03:42:29.923124 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:29.922441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:29.930126 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:29.930082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1ecd1bc-f07d-417c-87ef-3a58e8992138-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-j577x\" (UID: \"b1ecd1bc-f07d-417c-87ef-3a58e8992138\") " pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:30.174761 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.174654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v" event={"ID":"38885313-c91a-489d-a603-fba5c1ce6fc9","Type":"ContainerStarted","Data":"caa12a78aaa5234e80dc2e01ca1a96c9c3231a7966f092c50802727b50962b73"}
Jul 13 03:42:30.177562 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.176930    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:30.178820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.178600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v"
Jul 13 03:42:30.179402 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.179208    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x5zfx\""
Jul 13 03:42:30.181597 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.180949    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7" event={"ID":"c7825d01-a8e5-432b-91d0-4116ce41f3f1","Type":"ContainerStarted","Data":"abd83f0d53cef923b3a9a0e2c47ff540624f2234b492f3450a863abf5e91e5ae"}
Jul 13 03:42:30.181597 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.180984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7" event={"ID":"c7825d01-a8e5-432b-91d0-4116ce41f3f1","Type":"ContainerStarted","Data":"60678b250fdc0d96b0c742f91c6c381f72073890b9b913de9ed2d764c1dc53c0"}
Jul 13 03:42:30.181597 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.181004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7" event={"ID":"c7825d01-a8e5-432b-91d0-4116ce41f3f1","Type":"ContainerStarted","Data":"b72da06e7346791c81499b249707b0b7f3639d1677a4bd4ca232e19fa016432c"}
Jul 13 03:42:30.183530 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.183478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fks58" event={"ID":"1889e832-d11e-4813-85ce-c9472ecfa0a0","Type":"ContainerStarted","Data":"ec4d52689f390e015bab74e9151f3fa4147213ffb3d82ab9a122d5b9bab407e6"}
Jul 13 03:42:30.185550 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.185491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fmf2" event={"ID":"5750286c-524f-47e3-a18f-3a4d6fef1c5b","Type":"ContainerStarted","Data":"c6826c88ee32316f3f151102b1d9a6ce1568b2cbf9eaacaca6f6e3abf6af048b"}
Jul 13 03:42:30.187894 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.187573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-j577x"
Jul 13 03:42:30.188473 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.188440    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zn6ft" event={"ID":"b05e482c-5ba2-46b3-9915-579c6aa4a945","Type":"ContainerStarted","Data":"04537a8862c4c77aca12acba209ebb551470de6db3124e4d906e4d025036b4f4"}
Jul 13 03:42:30.208702 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.208032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-84844d9ccb-2nr8v" podStartSLOduration=1.7854365639999998 podStartE2EDuration="8.207988245s" totalImagesPullingTime="6.422551681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:30.191907981 +0000 UTC m=+68.967622274" watchObservedRunningTime="2026-07-13 03:42:30.207988245 +0000 UTC m=+68.983702526"
Jul 13 03:42:30.227942 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.227569    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-fd8c7b74c-ggpb7" podStartSLOduration=1.821854932 podStartE2EDuration="8.227550433s" totalImagesPullingTime="6.405695501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:30.226238334 +0000 UTC m=+69.001952614" watchObservedRunningTime="2026-07-13 03:42:30.227550433 +0000 UTC m=+69.003264714"
Jul 13 03:42:30.243140 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.243112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:30.337579 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.337546    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:30.384744 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.384695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-j577x"]
Jul 13 03:42:30.490810 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:30.490629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:30.780885 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:30.780812    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1ecd1bc_f07d_417c_87ef_3a58e8992138.slice/crio-4f969be8714544a9d14617f25a0a1f48ba9cdd72c87644e3d9f69d6c15ef5de9 WatchSource:0}: Error finding container 4f969be8714544a9d14617f25a0a1f48ba9cdd72c87644e3d9f69d6c15ef5de9: Status 404 returned error can't find the container with id 4f969be8714544a9d14617f25a0a1f48ba9cdd72c87644e3d9f69d6c15ef5de9
Jul 13 03:42:31.196432 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:31.195789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j577x" event={"ID":"b1ecd1bc-f07d-417c-87ef-3a58e8992138","Type":"ContainerStarted","Data":"4f969be8714544a9d14617f25a0a1f48ba9cdd72c87644e3d9f69d6c15ef5de9"}
Jul 13 03:42:31.638905 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:31.638862    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:32.207325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.207096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fmf2" event={"ID":"5750286c-524f-47e3-a18f-3a4d6fef1c5b","Type":"ContainerStarted","Data":"85ad3458156ccdc5e107b6235b852e7d05c7a07535359a57cf26bdd4e19e647d"}
Jul 13 03:42:32.207325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.207276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fmf2" event={"ID":"5750286c-524f-47e3-a18f-3a4d6fef1c5b","Type":"ContainerStarted","Data":"e79c9fae12c4ae20070d12356f0740cf452bd05189a196c801e80c72932ad20a"}
Jul 13 03:42:32.225562 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.225503    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7fmf2" podStartSLOduration=68.445575814 podStartE2EDuration="1m10.225483347s" totalImagesPullingTime="1.779907533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:32.221906505 +0000 UTC m=+70.997620786" watchObservedRunningTime="2026-07-13 03:42:32.225483347 +0000 UTC m=+71.001197627"
Jul 13 03:42:32.338698 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.338654    2582 patch_prober.go:28] interesting pod/image-registry-58f447dc86-88w6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 03:42:32.338876 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.338716    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 03:42:32.339517 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.339483    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:32.439921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:32.439842    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:35.249872 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:35.249832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:35.347011 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:35.346950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:35.396610 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:35.396562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:36.178091 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:36.178059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:36.977917 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:36.977817    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:37.080524 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:37.080494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:37.179916 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:37.179860    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:37.233931 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:37.233826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:38.383861 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.383811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:38.580209 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.580164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:38.662088 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.662004    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:38.670128 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.670102    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7dpfp"]
Jul 13 03:42:38.674034 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.673522    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.677652 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.677631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 03:42:38.679031 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.678647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 03:42:38.679031 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.678687    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 03:42:38.679031 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.678898    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 03:42:38.679031 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.678932    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pjmmw\""
Jul 13 03:42:38.679310 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.679058    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 03:42:38.679310 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.679140    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 03:42:38.790908 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.790872    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:38.794014 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.793984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-sys\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-root\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794111    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794321 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-wtmp\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794321 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-metrics-client-ca\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794321 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc4ts\" (UniqueName: \"kubernetes.io/projected/60bc5b45-325a-40d1-a0c5-079a820cca51-kube-api-access-xc4ts\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.794321 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.794236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-textfile\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895095 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895272 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895272 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-wtmp\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895272 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-metrics-client-ca\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895435 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895315    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-wtmp\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895435 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895370    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc4ts\" (UniqueName: \"kubernetes.io/projected/60bc5b45-325a-40d1-a0c5-079a820cca51-kube-api-access-xc4ts\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895435 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-textfile\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895578 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-sys\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895578 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-root\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895578 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895544    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895711 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:38.895675    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 13 03:42:38.895800 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:38.895774    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls podName:60bc5b45-325a-40d1-a0c5-079a820cca51 nodeName:}" failed. No retries permitted until 2026-07-13 03:42:39.395753642 +0000 UTC m=+78.171467915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls") pod "node-exporter-7dpfp" (UID: "60bc5b45-325a-40d1-a0c5-079a820cca51") : secret "node-exporter-tls" not found
Jul 13 03:42:38.895858 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895842    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-accelerators-collector-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895906 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895856    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bc5b45-325a-40d1-a0c5-079a820cca51-metrics-client-ca\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.895956 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.895913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-sys\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.896181 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.896139    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-textfile\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.896311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.896190    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/60bc5b45-325a-40d1-a0c5-079a820cca51-root\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.898647 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.898623    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.904948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.904902    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc4ts\" (UniqueName: \"kubernetes.io/projected/60bc5b45-325a-40d1-a0c5-079a820cca51-kube-api-access-xc4ts\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:38.935060 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:38.934967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.036042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.036008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.137258 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.137220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.236798 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.236701    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.400421 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.400386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:39.403072 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.403044    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/60bc5b45-325a-40d1-a0c5-079a820cca51-node-exporter-tls\") pod \"node-exporter-7dpfp\" (UID: \"60bc5b45-325a-40d1-a0c5-079a820cca51\") " pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:39.586635 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.586590    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7dpfp"
Jul 13 03:42:39.641370 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.641338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.727005 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.726960    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:39.941451 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:39.941368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:40.748665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:40.748611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:40.849968 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:40.849932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:41.566971 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:41.566938    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:41.667890 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:41.667798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:41.947465 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:41.947376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:42.332115 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:42.332090    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:42.427930 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:42.427887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:42.665677 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:42.665598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:42.718923 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:42.718894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:42.998054 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:42.997974    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:43.068965 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:43.068926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:43.398665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:43.398633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:43.499002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:43.498972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:43.723898 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:43.723808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.153967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.153935    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-55dcb6bb67-p52v5"
Jul 13 03:42:44.272229 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.272199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.373450 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.373415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.431234 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.431154    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.706643 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.706571    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.807055 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.807022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:44.878508 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:44.878472    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:45.208146 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:45.208122    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bc5b45_325a_40d1_a0c5_079a820cca51.slice/crio-783b5a73d5ee56510f1a374eba782c7bcf091f82c821246dbbeb7292beb9e43a WatchSource:0}: Error finding container 783b5a73d5ee56510f1a374eba782c7bcf091f82c821246dbbeb7292beb9e43a: Status 404 returned error can't find the container with id 783b5a73d5ee56510f1a374eba782c7bcf091f82c821246dbbeb7292beb9e43a
Jul 13 03:42:45.231405 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:45.231375    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:45.256266 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:45.256236    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dpfp" event={"ID":"60bc5b45-325a-40d1-a0c5-079a820cca51","Type":"ContainerStarted","Data":"783b5a73d5ee56510f1a374eba782c7bcf091f82c821246dbbeb7292beb9e43a"}
Jul 13 03:42:45.331687 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:45.331655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:46.273318 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.273280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-kbx4w" event={"ID":"e9f03bcb-8d30-4256-b41f-25de126a9f30","Type":"ContainerStarted","Data":"557ca8c7453d176854b2bdf4415260343fb4c50d491fed90550160b100f3bc66"}
Jul 13 03:42:46.275263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.273703    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:46.276198 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.276170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zn6ft" event={"ID":"b05e482c-5ba2-46b3-9915-579c6aa4a945","Type":"ContainerStarted","Data":"ac09f3f8d28b019e7f1d1ad2c7c18145e9bdf9e53adebd06284166cd0271624b"}
Jul 13 03:42:46.276320 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.276248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:42:46.278125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.278098    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j577x" event={"ID":"b1ecd1bc-f07d-417c-87ef-3a58e8992138","Type":"ContainerStarted","Data":"45528f6bd2ad26b2337be5c452402c14d92adef04fade84dac172befe062a52f"}
Jul 13 03:42:46.279787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.279765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fks58" event={"ID":"1889e832-d11e-4813-85ce-c9472ecfa0a0","Type":"ContainerStarted","Data":"d57c6a629ad2f7e784b1bae9733ee5a994014c5bd35068c4a64bb7effea3a59c"}
Jul 13 03:42:46.288257 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.288241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-kbx4w"
Jul 13 03:42:46.292681 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.292631    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-kbx4w" podStartSLOduration=1.870947693 podStartE2EDuration="24.292615315s" totalImagesPullingTime="22.421667622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:46.290110708 +0000 UTC m=+85.065824993" watchObservedRunningTime="2026-07-13 03:42:46.292615315 +0000 UTC m=+85.068329596"
Jul 13 03:42:46.319242 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.319195    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fks58" podStartSLOduration=68.474018413 podStartE2EDuration="1m24.319178256s" totalImagesPullingTime="15.845159843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:46.318252631 +0000 UTC m=+85.093966911" watchObservedRunningTime="2026-07-13 03:42:46.319178256 +0000 UTC m=+85.094892738"
Jul 13 03:42:46.333812 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:46.333767    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zn6ft" podStartSLOduration=69.043271745 podStartE2EDuration="1m24.33375076s" totalImagesPullingTime="15.290479015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:46.332846433 +0000 UTC m=+85.108560705" watchObservedRunningTime="2026-07-13 03:42:46.33375076 +0000 UTC m=+85.109465032"
Jul 13 03:42:47.044038 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.043997    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:47.093923 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.093845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:47.286517 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.286478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j577x" event={"ID":"b1ecd1bc-f07d-417c-87ef-3a58e8992138","Type":"ContainerStarted","Data":"01e90177eea0d9aaf00f00000655652a524c56f0589dce1f7d9a7d719504b7d6"}
Jul 13 03:42:47.288585 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.288549    2582 generic.go:356] "Generic (PLEG): container finished" podID="60bc5b45-325a-40d1-a0c5-079a820cca51" containerID="c4cee381373fcf5edec9666a403538961993107598b462130fbbf31699913373" exitCode=0
Jul 13 03:42:47.288747 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.288634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dpfp" event={"ID":"60bc5b45-325a-40d1-a0c5-079a820cca51","Type":"ContainerDied","Data":"c4cee381373fcf5edec9666a403538961993107598b462130fbbf31699913373"}
Jul 13 03:42:47.347435 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.347313    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" containerName="registry" containerID="cri-o://678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a" gracePeriod=30
Jul 13 03:42:47.648158 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.647905    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:47.669139 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669109    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.669263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669154    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk29b\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.669263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.669263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669230    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.669921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.670042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669956    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.670042 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.669996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.670161 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.670103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates\") pod \"8b88b435-7635-487b-b524-1475bfbe45cb\" (UID: \"8b88b435-7635-487b-b524-1475bfbe45cb\") "
Jul 13 03:42:47.670764 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.670306    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:42:47.670764 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.670648    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:42:47.672264 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.672225    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:42:47.673829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.673761    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b" (OuterVolumeSpecName: "kube-api-access-mk29b") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "kube-api-access-mk29b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:42:47.679232 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.679111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:42:47.679232 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.679204    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:42:47.682514 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.681833    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:42:47.682820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.682781    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8b88b435-7635-487b-b524-1475bfbe45cb" (UID: "8b88b435-7635-487b-b524-1475bfbe45cb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:42:47.771051 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771023    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-registry-certificates\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771416 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771397    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-registry-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771549    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk29b\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-kube-api-access-mk29b\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771575    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8b88b435-7635-487b-b524-1475bfbe45cb-bound-sa-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771590    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-installation-pull-secrets\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771605    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8b88b435-7635-487b-b524-1475bfbe45cb-trusted-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771614    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8b88b435-7635-487b-b524-1475bfbe45cb-ca-trust-extracted\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:47.771787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:47.771623    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8b88b435-7635-487b-b524-1475bfbe45cb-image-registry-private-configuration\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:42:48.297495 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.297409    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dpfp" event={"ID":"60bc5b45-325a-40d1-a0c5-079a820cca51","Type":"ContainerStarted","Data":"0eb635999832cba52deeebb46eb10399ec7413da4d8ca7f36ef9e37887c65929"}
Jul 13 03:42:48.298014 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.297513    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7dpfp" event={"ID":"60bc5b45-325a-40d1-a0c5-079a820cca51","Type":"ContainerStarted","Data":"5b5d2a0817cd979630929c3cf20b1caacd76b5abcad7c351b119e35538178afd"}
Jul 13 03:42:48.299892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.299786    2582 generic.go:356] "Generic (PLEG): container finished" podID="8b88b435-7635-487b-b524-1475bfbe45cb" containerID="678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a" exitCode=0
Jul 13 03:42:48.299892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.299817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" event={"ID":"8b88b435-7635-487b-b524-1475bfbe45cb","Type":"ContainerDied","Data":"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"}
Jul 13 03:42:48.299892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.299836    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58f447dc86-88w6k"
Jul 13 03:42:48.299892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.299868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58f447dc86-88w6k" event={"ID":"8b88b435-7635-487b-b524-1475bfbe45cb","Type":"ContainerDied","Data":"80b845998b389573c7e3cb9ab70044247ab59f2062e66869abfa42daf8f9a592"}
Jul 13 03:42:48.300300 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.299898    2582 scope.go:117] "RemoveContainer" containerID="678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"
Jul 13 03:42:48.310754 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.310640    2582 scope.go:117] "RemoveContainer" containerID="678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"
Jul 13 03:42:48.311077 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:42:48.311033    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a\": container with ID starting with 678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a not found: ID does not exist" containerID="678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"
Jul 13 03:42:48.311189 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.311072    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a"} err="failed to get container status \"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a\": rpc error: code = NotFound desc = could not find container \"678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a\": container with ID starting with 678c4b3d6eca3e6347e7043e0de78e5adad7c6aa6b8948e216835d6eb9f6d31a not found: ID does not exist"
Jul 13 03:42:48.316832 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.316787    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7dpfp" podStartSLOduration=8.555852374 podStartE2EDuration="10.316774267s" totalImagesPullingTime="1.655224026s" totalInitContainerRuntime="105.697867ms" isStatefulPod=true podCreationTimestamp="2026-07-13 03:42:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:48.31464035 +0000 UTC m=+87.090354644" watchObservedRunningTime="2026-07-13 03:42:48.316774267 +0000 UTC m=+87.092488537"
Jul 13 03:42:48.330309 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.330283    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:42:48.336048 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:48.336021    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58f447dc86-88w6k"]
Jul 13 03:42:49.760715 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:49.760636    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" path="/var/lib/kubelet/pods/8b88b435-7635-487b-b524-1475bfbe45cb/volumes"
Jul 13 03:42:49.949057 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:49.949008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:50.559272 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:50.559222    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:51.145611 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.145582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:51.154360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.154333    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:42:51.154665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.154647    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" containerName="registry"
Jul 13 03:42:51.154762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.154668    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" containerName="registry"
Jul 13 03:42:51.154762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.154718    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b88b435-7635-487b-b524-1475bfbe45cb" containerName="registry"
Jul 13 03:42:51.184616 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.184592    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:42:51.184760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.184698    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.187367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.187310    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 03:42:51.187367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.187334    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 03:42:51.188180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.188117    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6nlsh\""
Jul 13 03:42:51.188180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.188202    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 03:42:51.188382 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.188235    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 03:42:51.188382 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.188206    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 03:42:51.199015 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.198994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2b2f\" (UniqueName: \"kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199255 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199255 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199144    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.199255 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.199243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.207946 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.207927    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 03:42:51.208067 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.208043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:51.300478 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.300670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300499    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2b2f\" (UniqueName: \"kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.300670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300535    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.300670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300562    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.300670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.300946 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300893    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.301006 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.300972    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.301336 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.301277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.301336 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.301277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.301588 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.301562    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.301789 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.301765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.303992 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.303970    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.304125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.304102    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.309397 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.309377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2b2f\" (UniqueName: \"kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f\") pod \"console-59db7b58b-v2k8w\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") " pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.319112 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.319081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-j577x" event={"ID":"b1ecd1bc-f07d-417c-87ef-3a58e8992138","Type":"ContainerStarted","Data":"36f62e1b299fe3d8faf028848c9a139ccb22bd7b326d7a809dfa3d5831566e35"}
Jul 13 03:42:51.336427 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.336378    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-j577x" podStartSLOduration=34.007309226 podStartE2EDuration="53.336359879s" totalImagesPullingTime="19.329050653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 03:41:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:51.335159019 +0000 UTC m=+90.110873300" watchObservedRunningTime="2026-07-13 03:42:51.336359879 +0000 UTC m=+90.112074159"
Jul 13 03:42:51.495722 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.495634    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:42:51.680399 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:51.680364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:42:51.685160 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:42:51.685106    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d970861_b599_4a25_9eca_999e2d3d5fdf.slice/crio-89b41ef4e2a9a59ca33a715d69c86c0675761afec709835ddfcfef258812f841 WatchSource:0}: Error finding container 89b41ef4e2a9a59ca33a715d69c86c0675761afec709835ddfcfef258812f841: Status 404 returned error can't find the container with id 89b41ef4e2a9a59ca33a715d69c86c0675761afec709835ddfcfef258812f841
Jul 13 03:42:52.326370 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:52.326323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59db7b58b-v2k8w" event={"ID":"0d970861-b599-4a25-9eca-999e2d3d5fdf","Type":"ContainerStarted","Data":"89b41ef4e2a9a59ca33a715d69c86c0675761afec709835ddfcfef258812f841"}
Jul 13 03:42:55.195137 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:55.195108    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:55.296056 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:55.296025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:55.341054 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:55.341017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59db7b58b-v2k8w" event={"ID":"0d970861-b599-4a25-9eca-999e2d3d5fdf","Type":"ContainerStarted","Data":"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"}
Jul 13 03:42:55.359704 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:55.359651    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59db7b58b-v2k8w" podStartSLOduration=0.840173403 podStartE2EDuration="4.359635183s" totalImagesPullingTime="3.51946178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:42:55.358238203 +0000 UTC m=+94.133952508" watchObservedRunningTime="2026-07-13 03:42:55.359635183 +0000 UTC m=+94.135349502"
Jul 13 03:42:56.108977 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:56.108935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:56.210161 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:56.210114    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:56.706370 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:56.706336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:56.757941 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:56.757901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:57.505316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:57.505281    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:57.553218 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:57.553192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:58.007064 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:58.007036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:42:58.107242 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:42:58.107212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:01.496815 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:01.496708    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:43:01.496815 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:01.496792    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:43:01.501813 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:01.501789    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:43:02.368347 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:02.368319    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:43:02.513260 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:02.513226    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:02.622428 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:02.622347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:02.719990 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:02.719956    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:13.002057 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:13.002022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:13.103200 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:13.103166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:13.443480 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:13.443445    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:17.290759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:17.290712    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zn6ft"
Jul 13 03:43:26.955129 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:26.955092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:27.999331 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:27.999299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:28.052174 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:28.052145    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:32.270126 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:32.270091    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:32.340252 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:32.340221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:54.707400 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:54.707364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:43:54.754465 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:43:54.754415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:06.665548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:06.665518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:06.727386 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:06.727357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:13.010002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:13.009967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:13.110742 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:13.110710    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:21.867153 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.867067    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:44:21.869620 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.869603    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.893970 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.893946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:44:21.950039 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.949993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:21.969175 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2th8m\" (UniqueName: \"kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969223    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.969325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.969324    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:21.999923 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:21.999893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:22.051597 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.051568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:22.069923 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.069890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.069934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.069979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070001    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070237 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2th8m\" (UniqueName: \"kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070361 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070899 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.070899 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.071049 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.071049 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.070924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.073017 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.073000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.073122 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.072999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.077392 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.077372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2th8m\" (UniqueName: \"kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m\") pod \"console-545c864c7-xtv6m\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") " pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.178125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.178040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:22.302759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.302697    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:44:22.305992 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:44:22.305966    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc149f7ec_eec2_43e1_b917_9167632a1d90.slice/crio-8126da2b0f20e60a09c9bc671d818b708aa07807b8a40ed99d1ebc8f44af2152 WatchSource:0}: Error finding container 8126da2b0f20e60a09c9bc671d818b708aa07807b8a40ed99d1ebc8f44af2152: Status 404 returned error can't find the container with id 8126da2b0f20e60a09c9bc671d818b708aa07807b8a40ed99d1ebc8f44af2152
Jul 13 03:44:22.637692 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.637654    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545c864c7-xtv6m" event={"ID":"c149f7ec-eec2-43e1-b917-9167632a1d90","Type":"ContainerStarted","Data":"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"}
Jul 13 03:44:22.637868 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.637711    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545c864c7-xtv6m" event={"ID":"c149f7ec-eec2-43e1-b917-9167632a1d90","Type":"ContainerStarted","Data":"8126da2b0f20e60a09c9bc671d818b708aa07807b8a40ed99d1ebc8f44af2152"}
Jul 13 03:44:22.654808 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.654756    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-545c864c7-xtv6m" podStartSLOduration=1.654711153 podStartE2EDuration="1.654711153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:44:22.653451955 +0000 UTC m=+181.429166236" watchObservedRunningTime="2026-07-13 03:44:22.654711153 +0000 UTC m=+181.430425432"
Jul 13 03:44:22.864448 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.864410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:22.916107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:22.916031    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:32.178584 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.178542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:32.179091 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.178604    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:32.183857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.183833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:32.677921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.677892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:44:32.719280 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.719245    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:44:32.850538 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.850503    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:32.945327 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.945257    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:32.995434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:32.995413    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:57.041016 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:57.040982    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:57.142619 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:57.142578    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:57.739687 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:57.739618    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59db7b58b-v2k8w" podUID="0d970861-b599-4a25-9eca-999e2d3d5fdf" containerName="console" containerID="cri-o://05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73" gracePeriod=15
Jul 13 03:44:57.977060 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:57.977032    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:44:58.040003 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.039928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040003 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.039971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040003 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040027    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040047    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040075    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2b2f\" (UniqueName: \"kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f\") pod \"0d970861-b599-4a25-9eca-999e2d3d5fdf\" (UID: \"0d970861-b599-4a25-9eca-999e2d3d5fdf\") "
Jul 13 03:44:58.040450 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:44:58.040500 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040470    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config" (OuterVolumeSpecName: "console-config") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:44:58.040561 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040492    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:44:58.040843 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.040818    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca" (OuterVolumeSpecName: "service-ca") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:44:58.042413 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.042377    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:44:58.042686 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.042433    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:44:58.042686 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.042471    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f" (OuterVolumeSpecName: "kube-api-access-n2b2f") pod "0d970861-b599-4a25-9eca-999e2d3d5fdf" (UID: "0d970861-b599-4a25-9eca-999e2d3d5fdf"). InnerVolumeSpecName "kube-api-access-n2b2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:44:58.141360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141320    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-oauth-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141351    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141362    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-oauth-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141371    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141616 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141379    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-console-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141616 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141388    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d970861-b599-4a25-9eca-999e2d3d5fdf-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.141616 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.141396    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2b2f\" (UniqueName: \"kubernetes.io/projected/0d970861-b599-4a25-9eca-999e2d3d5fdf-kube-api-access-n2b2f\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:44:58.761488 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.761448    2582 generic.go:356] "Generic (PLEG): container finished" podID="0d970861-b599-4a25-9eca-999e2d3d5fdf" containerID="05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73" exitCode=0
Jul 13 03:44:58.761666 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.761512    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59db7b58b-v2k8w"
Jul 13 03:44:58.761666 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.761533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59db7b58b-v2k8w" event={"ID":"0d970861-b599-4a25-9eca-999e2d3d5fdf","Type":"ContainerDied","Data":"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"}
Jul 13 03:44:58.761666 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.761589    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59db7b58b-v2k8w" event={"ID":"0d970861-b599-4a25-9eca-999e2d3d5fdf","Type":"ContainerDied","Data":"89b41ef4e2a9a59ca33a715d69c86c0675761afec709835ddfcfef258812f841"}
Jul 13 03:44:58.761666 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.761611    2582 scope.go:117] "RemoveContainer" containerID="05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"
Jul 13 03:44:58.769716 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.769461    2582 scope.go:117] "RemoveContainer" containerID="05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"
Jul 13 03:44:58.769917 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:44:58.769896    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73\": container with ID starting with 05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73 not found: ID does not exist" containerID="05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"
Jul 13 03:44:58.769981 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.769930    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73"} err="failed to get container status \"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73\": rpc error: code = NotFound desc = could not find container \"05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73\": container with ID starting with 05acf83148d8f0dd714f4225dc1bfdd64509541c304cff5272527733ba909e73 not found: ID does not exist"
Jul 13 03:44:58.781110 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.781087    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:44:58.784578 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:58.784558    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59db7b58b-v2k8w"]
Jul 13 03:44:59.438926 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:59.438894    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:44:59.758536 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:44:59.758462    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d970861-b599-4a25-9eca-999e2d3d5fdf" path="/var/lib/kubelet/pods/0d970861-b599-4a25-9eca-999e2d3d5fdf/volumes"
Jul 13 03:45:02.367927 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:02.367897    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:02.425857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:02.425820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:23.641158 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:23.641121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:24.414141 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:24.414106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:25.527238 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.527204    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"]
Jul 13 03:45:25.527601 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.527438    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d970861-b599-4a25-9eca-999e2d3d5fdf" containerName="console"
Jul 13 03:45:25.527601 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.527449    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d970861-b599-4a25-9eca-999e2d3d5fdf" containerName="console"
Jul 13 03:45:25.527601 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.527499    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d970861-b599-4a25-9eca-999e2d3d5fdf" containerName="console"
Jul 13 03:45:25.529886 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.529868    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.532288 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.532258    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 13 03:45:25.532724 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.532704    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 13 03:45:25.532808 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.532748    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bcn2j\""
Jul 13 03:45:25.541716 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.541695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"]
Jul 13 03:45:25.637406 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.637360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kk5r\" (UniqueName: \"kubernetes.io/projected/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-kube-api-access-9kk5r\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.637583 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.637483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.738307 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.738263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.738467 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.738316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kk5r\" (UniqueName: \"kubernetes.io/projected/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-kube-api-access-9kk5r\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.738770 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.738721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.747277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.747249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kk5r\" (UniqueName: \"kubernetes.io/projected/8a834caf-52f1-4d44-bc6b-0e9d031cf1bd-kube-api-access-9kk5r\") pod \"cert-manager-operator-controller-manager-55c444bf86-4ktcp\" (UID: \"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.838862 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.838828    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"
Jul 13 03:45:25.973002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:25.972964    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp"]
Jul 13 03:45:25.976434 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:45:25.976384    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a834caf_52f1_4d44_bc6b_0e9d031cf1bd.slice/crio-cc7976b82d26f6b6b4dd3e557f2066326d53121f7dd77f4b459514a3eb2773b3 WatchSource:0}: Error finding container cc7976b82d26f6b6b4dd3e557f2066326d53121f7dd77f4b459514a3eb2773b3: Status 404 returned error can't find the container with id cc7976b82d26f6b6b4dd3e557f2066326d53121f7dd77f4b459514a3eb2773b3
Jul 13 03:45:26.854117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:26.854074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp" event={"ID":"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd","Type":"ContainerStarted","Data":"cc7976b82d26f6b6b4dd3e557f2066326d53121f7dd77f4b459514a3eb2773b3"}
Jul 13 03:45:27.219507 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:27.219390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:27.321246 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:27.321193    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:28.862867 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:28.862769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp" event={"ID":"8a834caf-52f1-4d44-bc6b-0e9d031cf1bd","Type":"ContainerStarted","Data":"8722c9dea35f2735077b370439f35b2cf875e75caa0f8968930500d1bffef52a"}
Jul 13 03:45:28.882134 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:28.882082    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4ktcp" podStartSLOduration=1.299415717 podStartE2EDuration="3.882062712s" totalImagesPullingTime="2.582646995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:45:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:45:28.880778485 +0000 UTC m=+247.656492766" watchObservedRunningTime="2026-07-13 03:45:28.882062712 +0000 UTC m=+247.657777005"
Jul 13 03:45:29.272385 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:29.272261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:29.387412 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:29.387368    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:29.527976 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:29.527877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:31.675443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:31.675376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:31.875130 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:31.875086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:34.026852 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:34.026812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:34.127020 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:34.126978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:38.872650 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:38.872596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:40.426336 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:40.426302    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:40.526413 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:40.526383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:41.542311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:41.542280    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:41.593419 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:41.593386    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:42.453504 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.453468    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"]
Jul 13 03:45:42.455641 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.455626    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.457998 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.457975    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 13 03:45:42.458127 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.457975    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zplgk\""
Jul 13 03:45:42.458829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.458816    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 13 03:45:42.463804 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.463782    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"]
Jul 13 03:45:42.561533 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.561498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dc812-9f52-4cb1-b9b6-64a223af9b79-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.561955 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.561556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqdw7\" (UniqueName: \"kubernetes.io/projected/b14dc812-9f52-4cb1-b9b6-64a223af9b79-kube-api-access-fqdw7\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.662913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.662875    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dc812-9f52-4cb1-b9b6-64a223af9b79-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.663088 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.662933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqdw7\" (UniqueName: \"kubernetes.io/projected/b14dc812-9f52-4cb1-b9b6-64a223af9b79-kube-api-access-fqdw7\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.663279 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.663259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b14dc812-9f52-4cb1-b9b6-64a223af9b79-tmp\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.670429 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.670398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqdw7\" (UniqueName: \"kubernetes.io/projected/b14dc812-9f52-4cb1-b9b6-64a223af9b79-kube-api-access-fqdw7\") pod \"openshift-lws-operator-fd8ccff4c-ktc6w\" (UID: \"b14dc812-9f52-4cb1-b9b6-64a223af9b79\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.765012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.764927    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"
Jul 13 03:45:42.889638 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.889603    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w"]
Jul 13 03:45:42.892686 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:45:42.892661    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb14dc812_9f52_4cb1_b9b6_64a223af9b79.slice/crio-175a3c42f6c4186ac3934ca21bb05a4a5776ce56cd813536e90cc998daffcfba WatchSource:0}: Error finding container 175a3c42f6c4186ac3934ca21bb05a4a5776ce56cd813536e90cc998daffcfba: Status 404 returned error can't find the container with id 175a3c42f6c4186ac3934ca21bb05a4a5776ce56cd813536e90cc998daffcfba
Jul 13 03:45:42.911601 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:42.911572    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w" event={"ID":"b14dc812-9f52-4cb1-b9b6-64a223af9b79","Type":"ContainerStarted","Data":"175a3c42f6c4186ac3934ca21bb05a4a5776ce56cd813536e90cc998daffcfba"}
Jul 13 03:45:45.925165 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:45.925132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w" event={"ID":"b14dc812-9f52-4cb1-b9b6-64a223af9b79","Type":"ContainerStarted","Data":"7f408eb9dad2e49927ebf998751bc1993f2f89edb2e37dbcacb53debe1c707b1"}
Jul 13 03:45:45.942463 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:45.942416    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-ktc6w" podStartSLOduration=1.3733815169999999 podStartE2EDuration="3.942400339s" totalImagesPullingTime="2.569018822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:45:45.940814074 +0000 UTC m=+264.716528354" watchObservedRunningTime="2026-07-13 03:45:45.942400339 +0000 UTC m=+264.718114619"
Jul 13 03:45:46.533175 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:46.533137    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:46.633514 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:46.633484    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:45:48.698974 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:45:48.698940    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:01.237170 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:01.237133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:01.338131 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:01.338088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:01.837790 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:01.837702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.036765 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.036712    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.132119 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.132024    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.166613 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.166580    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"]
Jul 13 03:46:02.172483 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.172459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.174927 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.174900    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 13 03:46:02.175286 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.175268    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dz94k\""
Jul 13 03:46:02.175369 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.175335    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 13 03:46:02.175475 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.175461    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 13 03:46:02.175592 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.175576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 13 03:46:02.189019 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.188998    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"]
Jul 13 03:46:02.196054 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.196028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.196142 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.196098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcrtz\" (UniqueName: \"kubernetes.io/projected/d016dc42-399e-48e6-ad4e-1220323f8da5-kube-api-access-mcrtz\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.196142 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.196131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.196215 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.196158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.196215 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.196204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.292918 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.292892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.297028 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.297144 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcrtz\" (UniqueName: \"kubernetes.io/projected/d016dc42-399e-48e6-ad4e-1220323f8da5-kube-api-access-mcrtz\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.297144 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297089    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.297144 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.297302 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.297392 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.297374    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-manifests\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.299190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.299169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d016dc42-399e-48e6-ad4e-1220323f8da5-tmp\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.299451 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.299432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-webhook-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.299514 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.299454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d016dc42-399e-48e6-ad4e-1220323f8da5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.306195 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.306173    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcrtz\" (UniqueName: \"kubernetes.io/projected/d016dc42-399e-48e6-ad4e-1220323f8da5-kube-api-access-mcrtz\") pod \"opendatahub-operator-controller-manager-6d6757d97b-c8wfc\" (UID: \"d016dc42-399e-48e6-ad4e-1220323f8da5\") " pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.378535 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.378505    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.481170 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.481099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.483072 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.483057    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:02.585226 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.585199    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.611661 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.611632    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"]
Jul 13 03:46:02.614967 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:02.614940    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd016dc42_399e_48e6_ad4e_1220323f8da5.slice/crio-42fe7d1e765424f772251182721fea27845ab06ed404d7f5cbdd5abe64c7af16 WatchSource:0}: Error finding container 42fe7d1e765424f772251182721fea27845ab06ed404d7f5cbdd5abe64c7af16: Status 404 returned error can't find the container with id 42fe7d1e765424f772251182721fea27845ab06ed404d7f5cbdd5abe64c7af16
Jul 13 03:46:02.688019 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.687990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:02.985889 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:02.985857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc" event={"ID":"d016dc42-399e-48e6-ad4e-1220323f8da5","Type":"ContainerStarted","Data":"42fe7d1e765424f772251182721fea27845ab06ed404d7f5cbdd5abe64c7af16"}
Jul 13 03:46:06.000321 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:06.000288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc" event={"ID":"d016dc42-399e-48e6-ad4e-1220323f8da5","Type":"ContainerStarted","Data":"2540abecbc0722383214692d61c1f8c972c8b5d85256928250098da05ccc939f"}
Jul 13 03:46:07.005820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:07.005717    2582 generic.go:356] "Generic (PLEG): container finished" podID="d016dc42-399e-48e6-ad4e-1220323f8da5" containerID="2540abecbc0722383214692d61c1f8c972c8b5d85256928250098da05ccc939f" exitCode=0
Jul 13 03:46:07.005820 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:07.005809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc" event={"ID":"d016dc42-399e-48e6-ad4e-1220323f8da5","Type":"ContainerDied","Data":"2540abecbc0722383214692d61c1f8c972c8b5d85256928250098da05ccc939f"}
Jul 13 03:46:08.011520 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:08.011487    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc" event={"ID":"d016dc42-399e-48e6-ad4e-1220323f8da5","Type":"ContainerStarted","Data":"133f842c16e9a231963aa07480e5d040fb3e4b569d762dc7515a448a98c9cb48"}
Jul 13 03:46:08.011922 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:08.011623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:08.031012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:08.030963    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc" podStartSLOduration=1.701158035 podStartE2EDuration="6.030943055s" totalImagesPullingTime="3.270503657s" totalInitContainerRuntime="1.059281363s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:08.029684969 +0000 UTC m=+286.805399248" watchObservedRunningTime="2026-07-13 03:46:08.030943055 +0000 UTC m=+286.806657335"
Jul 13 03:46:08.945160 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:08.945127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:09.045448 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:09.045395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:12.272914 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:12.272870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:13.345599 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:13.345564    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:13.444915 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:13.444873    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:19.017871 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:19.017838    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6d6757d97b-c8wfc"
Jul 13 03:46:20.780386 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:20.780354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:20.917698 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:20.917642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:21.649527 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.649498    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:46:21.662079 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.662048    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 03:46:21.663671 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.663646    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:46:21.670106 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.670076    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gnllr"]
Jul 13 03:46:21.676931 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.676910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.679277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.679258    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 13 03:46:21.679391 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.679323    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vx6w2\""
Jul 13 03:46:21.684751 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.684705    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gnllr"]
Jul 13 03:46:21.711828 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.711644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:21.745940 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.745906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jghkk\" (UniqueName: \"kubernetes.io/projected/508085c7-3f61-4aaa-9960-63ff9bbc9f25-kube-api-access-jghkk\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.746117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.746039    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508085c7-3f61-4aaa-9960-63ff9bbc9f25-cert\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.832688 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.832651    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:21.847086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.847060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jghkk\" (UniqueName: \"kubernetes.io/projected/508085c7-3f61-4aaa-9960-63ff9bbc9f25-kube-api-access-jghkk\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.847206 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.847114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508085c7-3f61-4aaa-9960-63ff9bbc9f25-cert\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.849591 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.849559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/508085c7-3f61-4aaa-9960-63ff9bbc9f25-cert\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.876875 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.876847    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jghkk\" (UniqueName: \"kubernetes.io/projected/508085c7-3f61-4aaa-9960-63ff9bbc9f25-kube-api-access-jghkk\") pod \"odh-model-controller-7998c67dc4-gnllr\" (UID: \"508085c7-3f61-4aaa-9960-63ff9bbc9f25\") " pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:21.922332 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.922227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:21.988780 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:21.988737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:22.123887 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.123856    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-gnllr"]
Jul 13 03:46:22.126683 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:22.126653    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508085c7_3f61_4aaa_9960_63ff9bbc9f25.slice/crio-2a0560a8ae8806759b5878ceb923014123b663177ca227b8966a0f180ef482ff WatchSource:0}: Error finding container 2a0560a8ae8806759b5878ceb923014123b663177ca227b8966a0f180ef482ff: Status 404 returned error can't find the container with id 2a0560a8ae8806759b5878ceb923014123b663177ca227b8966a0f180ef482ff
Jul 13 03:46:22.281053 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.280968    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gw9jk"]
Jul 13 03:46:22.284315 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.284272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:22.285710 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.285692    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.287934 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.287913    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 13 03:46:22.288024 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.287921    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8t5bx\""
Jul 13 03:46:22.296471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.296449    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gw9jk"]
Jul 13 03:46:22.350436 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.350401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/400064e0-1118-4939-9be9-da4d97f3912c-tls-certs\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.350588 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.350511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kjqk\" (UniqueName: \"kubernetes.io/projected/400064e0-1118-4939-9be9-da4d97f3912c-kube-api-access-6kjqk\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.368570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.368517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:22.451589 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.451548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kjqk\" (UniqueName: \"kubernetes.io/projected/400064e0-1118-4939-9be9-da4d97f3912c-kube-api-access-6kjqk\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.451764 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.451611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/400064e0-1118-4939-9be9-da4d97f3912c-tls-certs\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.454007 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.453983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/400064e0-1118-4939-9be9-da4d97f3912c-tls-certs\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.458829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.458804    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kjqk\" (UniqueName: \"kubernetes.io/projected/400064e0-1118-4939-9be9-da4d97f3912c-kube-api-access-6kjqk\") pod \"model-serving-api-54d89bd5fc-gw9jk\" (UID: \"400064e0-1118-4939-9be9-da4d97f3912c\") " pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.598659 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.598615    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:22.730528 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:22.730495    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gw9jk"]
Jul 13 03:46:22.734192 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:22.734165    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400064e0_1118_4939_9be9_da4d97f3912c.slice/crio-f9301e5972c8f9585c30f19d0112ab980e59c4d4fc0e0344e8a577b6a95c5303 WatchSource:0}: Error finding container f9301e5972c8f9585c30f19d0112ab980e59c4d4fc0e0344e8a577b6a95c5303: Status 404 returned error can't find the container with id f9301e5972c8f9585c30f19d0112ab980e59c4d4fc0e0344e8a577b6a95c5303
Jul 13 03:46:23.072502 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:23.072461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr" event={"ID":"508085c7-3f61-4aaa-9960-63ff9bbc9f25","Type":"ContainerStarted","Data":"2a0560a8ae8806759b5878ceb923014123b663177ca227b8966a0f180ef482ff"}
Jul 13 03:46:23.074132 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:23.074101    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk" event={"ID":"400064e0-1118-4939-9be9-da4d97f3912c","Type":"ContainerStarted","Data":"f9301e5972c8f9585c30f19d0112ab980e59c4d4fc0e0344e8a577b6a95c5303"}
Jul 13 03:46:26.089327 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.089281    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk" event={"ID":"400064e0-1118-4939-9be9-da4d97f3912c","Type":"ContainerStarted","Data":"1d6905a7243fbdd545dfa79cbc360c9720f86bcf30ac853c86123158c435241b"}
Jul 13 03:46:26.089810 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.089364    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:26.090833 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.090805    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr" event={"ID":"508085c7-3f61-4aaa-9960-63ff9bbc9f25","Type":"ContainerStarted","Data":"d31fb633ea209d73e381a69d99067afca589e45b256d2cb65d00756b653085e2"}
Jul 13 03:46:26.090956 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.090943    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:26.106029 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.105977    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk" podStartSLOduration=1.406550644 podStartE2EDuration="4.105962421s" totalImagesPullingTime="2.699411777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:26.104493066 +0000 UTC m=+304.880207336" watchObservedRunningTime="2026-07-13 03:46:26.105962421 +0000 UTC m=+304.881676699"
Jul 13 03:46:26.118222 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.118166    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr" podStartSLOduration=1.800883866 podStartE2EDuration="5.118146616s" totalImagesPullingTime="3.31726275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:26.117114304 +0000 UTC m=+304.892828584" watchObservedRunningTime="2026-07-13 03:46:26.118146616 +0000 UTC m=+304.893860896"
Jul 13 03:46:26.611094 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.611052    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:26.661743 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.661692    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"]
Jul 13 03:46:26.664982 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.664950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.667337 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.667316    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 03:46:26.668229 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.668211    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 13 03:46:26.668327 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.668219    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zdkr7\""
Jul 13 03:46:26.668327 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.668233    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 03:46:26.668446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.668288    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 13 03:46:26.675010 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.674975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"]
Jul 13 03:46:26.737034 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.737000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:26.787322 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.787290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjbqq\" (UniqueName: \"kubernetes.io/projected/eae1bc61-4640-44db-a1ba-0427a4671b5a-kube-api-access-qjbqq\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.787471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.787335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae1bc61-4640-44db-a1ba-0427a4671b5a-tls-certs\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.787471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.787401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae1bc61-4640-44db-a1ba-0427a4671b5a-tmp\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.888456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.888378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae1bc61-4640-44db-a1ba-0427a4671b5a-tls-certs\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.888456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.888423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae1bc61-4640-44db-a1ba-0427a4671b5a-tmp\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.888631 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.888492    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjbqq\" (UniqueName: \"kubernetes.io/projected/eae1bc61-4640-44db-a1ba-0427a4671b5a-kube-api-access-qjbqq\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.890663 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.890639    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eae1bc61-4640-44db-a1ba-0427a4671b5a-tmp\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.890793 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.890775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eae1bc61-4640-44db-a1ba-0427a4671b5a-tls-certs\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.895948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.895926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjbqq\" (UniqueName: \"kubernetes.io/projected/eae1bc61-4640-44db-a1ba-0427a4671b5a-kube-api-access-qjbqq\") pod \"kube-auth-proxy-7bfd7dd56-hzthb\" (UID: \"eae1bc61-4640-44db-a1ba-0427a4671b5a\") " pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:26.976201 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:26.976141    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"
Jul 13 03:46:27.108966 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.108933    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb"]
Jul 13 03:46:27.112856 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:27.112826    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae1bc61_4640_44db_a1ba_0427a4671b5a.slice/crio-91545da6f02ecc4ce383bf41b9bfa8a4857e23d21ea580123202dbddcafd2e58 WatchSource:0}: Error finding container 91545da6f02ecc4ce383bf41b9bfa8a4857e23d21ea580123202dbddcafd2e58: Status 404 returned error can't find the container with id 91545da6f02ecc4ce383bf41b9bfa8a4857e23d21ea580123202dbddcafd2e58
Jul 13 03:46:27.114540 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.114522    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:46:27.711647 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.711612    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:27.714483 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.714457    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:27.715996 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.715977    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.718597 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.718574    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 13 03:46:27.718708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.718609    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 13 03:46:27.718708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.718672    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 13 03:46:27.718708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.718686    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xbgf6\""
Jul 13 03:46:27.718708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.718683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 13 03:46:27.728239 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.728214    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:27.797004 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.796960    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797195 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797195 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797195 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797334 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797230    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6vhw\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797334 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.797334 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.797326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.813642 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.813608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:27.898719 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6vhw\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.898913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.898913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.898913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.898913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898862    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.898913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.899175 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.898942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.899804 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.899756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.901762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.901546    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.901762 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.901716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.902034 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.902008    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.902034 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.902022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.907514 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.907488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:27.907621 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:27.907500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6vhw\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw\") pod \"istiod-openshift-gateway-7574459656-nvbml\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:28.025655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:28.025566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:28.106587 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:28.106494    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb" event={"ID":"eae1bc61-4640-44db-a1ba-0427a4671b5a","Type":"ContainerStarted","Data":"91545da6f02ecc4ce383bf41b9bfa8a4857e23d21ea580123202dbddcafd2e58"}
Jul 13 03:46:28.185788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:28.185754    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:28.189094 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:28.189065    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd6516e_eeb7_4d65_b78f_5bfeae8c5e81.slice/crio-56db31752e60e053545b0f9f1cb2c1edc6223b4552fe8765a4061d7d0dcc2395 WatchSource:0}: Error finding container 56db31752e60e053545b0f9f1cb2c1edc6223b4552fe8765a4061d7d0dcc2395: Status 404 returned error can't find the container with id 56db31752e60e053545b0f9f1cb2c1edc6223b4552fe8765a4061d7d0dcc2395
Jul 13 03:46:28.978871 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:28.978824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:29.113563 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:29.113519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" event={"ID":"add6516e-eeb7-4d65-b78f-5bfeae8c5e81","Type":"ContainerStarted","Data":"56db31752e60e053545b0f9f1cb2c1edc6223b4552fe8765a4061d7d0dcc2395"}
Jul 13 03:46:30.881866 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:30.881818    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:46:30.882203 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:30.881907    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:46:31.125459 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.125365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" event={"ID":"add6516e-eeb7-4d65-b78f-5bfeae8c5e81","Type":"ContainerStarted","Data":"a4e4648dda31dba8aa3388be36fa2d6a58c0291870dc5156fe5021618b9bb624"}
Jul 13 03:46:31.125459 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.125432    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:31.127082 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.127044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb" event={"ID":"eae1bc61-4640-44db-a1ba-0427a4671b5a","Type":"ContainerStarted","Data":"142686e9a7b184be658caf4ce3bc20b9a14682425acd2c136368be2ae50d5d0a"}
Jul 13 03:46:31.127214 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.127169    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nvbml container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 03:46:31.127277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.127218    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 03:46:31.181394 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.181338    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" podStartSLOduration=1.491312252 podStartE2EDuration="4.181319125s" totalImagesPullingTime="2.690006873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:31.177571525 +0000 UTC m=+309.953285804" watchObservedRunningTime="2026-07-13 03:46:31.181319125 +0000 UTC m=+309.957033406"
Jul 13 03:46:31.208441 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.208380    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bfd7dd56-hzthb" podStartSLOduration=1.494724589 podStartE2EDuration="5.208362155s" totalImagesPullingTime="3.713637566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:31.206016977 +0000 UTC m=+309.981731270" watchObservedRunningTime="2026-07-13 03:46:31.208362155 +0000 UTC m=+309.984076436"
Jul 13 03:46:31.342590 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.342126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:31.434296 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.434214    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"]
Jul 13 03:46:31.437499 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.437478    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.440179 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.440156    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-gn8rw\""
Jul 13 03:46:31.440376 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.440360    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 13 03:46:31.444743 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.444694    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"]
Jul 13 03:46:31.448283 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.448264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.450503 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.450480    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:31.450617 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.450589    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 13 03:46:31.450723 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.450693    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-q5mbf\""
Jul 13 03:46:31.459587 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.455036    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"]
Jul 13 03:46:31.465858 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.465830    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"]
Jul 13 03:46:31.532038 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.532000    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:31.534179 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.534150    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.534313 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.534188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp5h6\" (UniqueName: \"kubernetes.io/projected/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-kube-api-access-pp5h6\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.534313 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.534252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjl6\" (UniqueName: \"kubernetes.io/projected/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-kube-api-access-8bjl6\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.534313 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.534275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.635200 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.635152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.635200 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.635201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp5h6\" (UniqueName: \"kubernetes.io/projected/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-kube-api-access-pp5h6\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.635419 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.635247    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjl6\" (UniqueName: \"kubernetes.io/projected/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-kube-api-access-8bjl6\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.635419 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.635270    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.635419 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:46:31.635308    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Jul 13 03:46:31.635419 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:46:31.635385    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert podName:0c7dc443-6fd7-4f5c-b4a4-991c007d91a5 nodeName:}" failed. No retries permitted until 2026-07-13 03:46:32.135363406 +0000 UTC m=+310.911077680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert") pod "kserve-controller-manager-d6f4b65b8-xjr82" (UID: "0c7dc443-6fd7-4f5c-b4a4-991c007d91a5") : secret "kserve-webhook-server-cert" not found
Jul 13 03:46:31.638032 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.638003    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.661622 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.661587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp5h6\" (UniqueName: \"kubernetes.io/projected/6f78cd9e-3d63-48b3-9ab7-7c20fd723943-kube-api-access-pp5h6\") pod \"llmisvc-controller-manager-777c6bd7d5-mjcvq\" (UID: \"6f78cd9e-3d63-48b3-9ab7-7c20fd723943\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.661750 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.661636    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjl6\" (UniqueName: \"kubernetes.io/projected/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-kube-api-access-8bjl6\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:31.698764 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.698663    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:31.768810 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.768773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:31.793672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.793643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:31.903947 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:31.903916    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"]
Jul 13 03:46:31.906604 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:31.906575    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f78cd9e_3d63_48b3_9ab7_7c20fd723943.slice/crio-26620ebe6e9c0fc1d4c9a6b25934858d72b84e1ddb65cff003d5472196791fa9 WatchSource:0}: Error finding container 26620ebe6e9c0fc1d4c9a6b25934858d72b84e1ddb65cff003d5472196791fa9: Status 404 returned error can't find the container with id 26620ebe6e9c0fc1d4c9a6b25934858d72b84e1ddb65cff003d5472196791fa9
Jul 13 03:46:32.132468 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.132427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq" event={"ID":"6f78cd9e-3d63-48b3-9ab7-7c20fd723943","Type":"ContainerStarted","Data":"26620ebe6e9c0fc1d4c9a6b25934858d72b84e1ddb65cff003d5472196791fa9"}
Jul 13 03:46:32.133269 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.133240    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nvbml container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 03:46:32.133394 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.133309    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 03:46:32.138623 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.138596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:32.140839 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.140820    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0c7dc443-6fd7-4f5c-b4a4-991c007d91a5-cert\") pod \"kserve-controller-manager-d6f4b65b8-xjr82\" (UID: \"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:32.188216 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.188184    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"]
Jul 13 03:46:32.193017 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.192993    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.195269 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.195250    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2vf8l\""
Jul 13 03:46:32.203460 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.203438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"]
Jul 13 03:46:32.215839 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.215814    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:32.340586 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340586 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340584    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-kube-api-access-5c4g7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340845 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340845 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340845 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340773    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340845 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340807    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.340845 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.341000 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fc71d85-fc40-48f9-997d-18cfe41b562b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.341000 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.340889    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.352515 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.352481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:32.442273 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442399    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fc71d85-fc40-48f9-997d-18cfe41b562b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442434 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-kube-api-access-5c4g7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442655 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.442834 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.442674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.443181 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.443021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.446008 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.443450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7fc71d85-fc40-48f9-997d-18cfe41b562b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.446008 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.443874    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.446008 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.445569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.446278 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.446253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.446446 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.446425    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.458612 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.458587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.458612 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.458609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c4g7\" (UniqueName: \"kubernetes.io/projected/7fc71d85-fc40-48f9-997d-18cfe41b562b-kube-api-access-5c4g7\") pod \"data-science-gateway-data-science-gateway-class-6576859cf45s49g\" (UID: \"7fc71d85-fc40-48f9-997d-18cfe41b562b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.494406 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.494378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"]
Jul 13 03:46:32.496020 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:32.495994    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c7dc443_6fd7_4f5c_b4a4_991c007d91a5.slice/crio-77308d80a90bbd9080a5dfd06c735a4bb8e6434d7debbec5eb1a93f078809a34 WatchSource:0}: Error finding container 77308d80a90bbd9080a5dfd06c735a4bb8e6434d7debbec5eb1a93f078809a34: Status 404 returned error can't find the container with id 77308d80a90bbd9080a5dfd06c735a4bb8e6434d7debbec5eb1a93f078809a34
Jul 13 03:46:32.498190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.498170    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:32.504029 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.504005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:32.649363 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.649328    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"]
Jul 13 03:46:32.676092 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:46:32.676012    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fc71d85_fc40_48f9_997d_18cfe41b562b.slice/crio-9724cb02eea815d5d1ca3c106a40adc134de1f720ebb43e7fb0577a47464edf8 WatchSource:0}: Error finding container 9724cb02eea815d5d1ca3c106a40adc134de1f720ebb43e7fb0577a47464edf8: Status 404 returned error can't find the container with id 9724cb02eea815d5d1ca3c106a40adc134de1f720ebb43e7fb0577a47464edf8
Jul 13 03:46:32.772519 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:32.772486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:33.138637 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:33.138599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g" event={"ID":"7fc71d85-fc40-48f9-997d-18cfe41b562b","Type":"ContainerStarted","Data":"9724cb02eea815d5d1ca3c106a40adc134de1f720ebb43e7fb0577a47464edf8"}
Jul 13 03:46:33.139705 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:33.139684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82" event={"ID":"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5","Type":"ContainerStarted","Data":"77308d80a90bbd9080a5dfd06c735a4bb8e6434d7debbec5eb1a93f078809a34"}
Jul 13 03:46:33.244523 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:33.244490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:33.345436 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:33.345400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:33.460435 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:33.460348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:34.559185 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:34.559149    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:34.559635 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:34.559366    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery" containerID="cri-o://a4e4648dda31dba8aa3388be36fa2d6a58c0291870dc5156fe5021618b9bb624" gracePeriod=30
Jul 13 03:46:34.560550 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:34.560452    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:35.151556 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:35.151521    2582 generic.go:356] "Generic (PLEG): container finished" podID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerID="a4e4648dda31dba8aa3388be36fa2d6a58c0291870dc5156fe5021618b9bb624" exitCode=0
Jul 13 03:46:35.151708 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:35.151578    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" event={"ID":"add6516e-eeb7-4d65-b78f-5bfeae8c5e81","Type":"ContainerDied","Data":"a4e4648dda31dba8aa3388be36fa2d6a58c0291870dc5156fe5021618b9bb624"}
Jul 13 03:46:36.293231 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.293185    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:46:36.293610 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.293278    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:46:36.293610 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.293318    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:46:36.301169 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.301151    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:36.384721 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384699    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.384838 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384746    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.384838 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.384940 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384872    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.384988 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384939    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.384988 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.384976    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.385087 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.385008    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6vhw\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw\") pod \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\" (UID: \"add6516e-eeb7-4d65-b78f-5bfeae8c5e81\") "
Jul 13 03:46:36.385594 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.385564    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:46:36.387326 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.387301    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts" (OuterVolumeSpecName: "cacerts") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:46:36.387577 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.387546    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:46:36.387577 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.387566    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs" (OuterVolumeSpecName: "local-certs") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:46:36.387749 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.387590    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:46:36.388421 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.388396    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw" (OuterVolumeSpecName: "kube-api-access-v6vhw") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "kube-api-access-v6vhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:46:36.388768 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.388694    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token" (OuterVolumeSpecName: "istio-token") pod "add6516e-eeb7-4d65-b78f-5bfeae8c5e81" (UID: "add6516e-eeb7-4d65-b78f-5bfeae8c5e81"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:46:36.486471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486438    2582 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-kubeconfig\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486468    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-dns-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486628 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486480    2582 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-csr-ca-configmap\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486628 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486494    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6vhw\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-kube-api-access-v6vhw\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486628 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486506    2582 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-local-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486628 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486514    2582 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-cacerts\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:36.486628 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:36.486521    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/add6516e-eeb7-4d65-b78f-5bfeae8c5e81-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:46:37.097547 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.097518    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-gnllr"
Jul 13 03:46:37.099357 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.099332    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gw9jk"
Jul 13 03:46:37.164340 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.164095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82" event={"ID":"0c7dc443-6fd7-4f5c-b4a4-991c007d91a5","Type":"ContainerStarted","Data":"5042c46e728928170f48feede1825b86155a7972482a6b8f16be936943553a4b"}
Jul 13 03:46:37.164340 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.164160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:46:37.165854 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.165818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq" event={"ID":"6f78cd9e-3d63-48b3-9ab7-7c20fd723943","Type":"ContainerStarted","Data":"9f2ce944a4ee21a04a8c9485fdfc243c94bf446e5b2e9ebe7dde6a0d7200d412"}
Jul 13 03:46:37.166296 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.166248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:46:37.167690 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.167670    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml" event={"ID":"add6516e-eeb7-4d65-b78f-5bfeae8c5e81","Type":"ContainerDied","Data":"56db31752e60e053545b0f9f1cb2c1edc6223b4552fe8765a4061d7d0dcc2395"}
Jul 13 03:46:37.167690 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.167693    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"
Jul 13 03:46:37.167855 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.167714    2582 scope.go:117] "RemoveContainer" containerID="a4e4648dda31dba8aa3388be36fa2d6a58c0291870dc5156fe5021618b9bb624"
Jul 13 03:46:37.170342 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.170243    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g" event={"ID":"7fc71d85-fc40-48f9-997d-18cfe41b562b","Type":"ContainerStarted","Data":"21995634ab500316ed80f9feda5346e6ecbb10e027e8528857afc43daa29ac1a"}
Jul 13 03:46:37.200468 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.200427    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82" podStartSLOduration=2.362845035 podStartE2EDuration="6.200414065s" totalImagesPullingTime="3.83756903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:37.198808116 +0000 UTC m=+315.974522395" watchObservedRunningTime="2026-07-13 03:46:37.200414065 +0000 UTC m=+315.976128378"
Jul 13 03:46:37.229710 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.229660    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g" podStartSLOduration=1.615022489 podStartE2EDuration="5.229644451s" totalImagesPullingTime="3.614621962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:37.228422316 +0000 UTC m=+316.004136594" watchObservedRunningTime="2026-07-13 03:46:37.229644451 +0000 UTC m=+316.005358729"
Jul 13 03:46:37.244037 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.244017    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:37.252948 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.252924    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nvbml"]
Jul 13 03:46:37.268186 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.268149    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq" podStartSLOduration=1.884309146 podStartE2EDuration="6.268135423s" totalImagesPullingTime="4.383826277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:46:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:46:37.267469685 +0000 UTC m=+316.043183963" watchObservedRunningTime="2026-07-13 03:46:37.268135423 +0000 UTC m=+316.043849702"
Jul 13 03:46:37.505015 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.504928    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:37.509892 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.509868    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:37.760332 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.760245    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" path="/var/lib/kubelet/pods/add6516e-eeb7-4d65-b78f-5bfeae8c5e81/volumes"
Jul 13 03:46:37.823266 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.823227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:37.924299 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:37.924269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:38.175687 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:38.175651    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:38.176439 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:38.176422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf45s49g"
Jul 13 03:46:41.861646 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:41.861608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:41.914303 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:41.914269    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:43.810457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:43.810429    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:43.861421 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:43.861381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:58.014908 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:58.014877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:46:58.110840 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:46:58.110808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:08.180182 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:08.180152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xjr82"
Jul 13 03:47:09.181918 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:09.181883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-mjcvq"
Jul 13 03:47:22.280208 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.280172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:22.384282 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.384247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:22.401775 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.401738    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:22.402038 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.402027    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery"
Jul 13 03:47:22.402081 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.402039    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery"
Jul 13 03:47:22.402114 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.402087    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="add6516e-eeb7-4d65-b78f-5bfeae8c5e81" containerName="discovery"
Jul 13 03:47:22.404771 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.404750    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:22.407369 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.407343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 13 03:47:22.407369 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.407343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 13 03:47:22.408822 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.408799    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-l2qsv\""
Jul 13 03:47:22.415012 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.414982    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:22.460064 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.460018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdmnh\" (UniqueName: \"kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh\") pod \"kuadrant-operator-catalog-6hhl8\" (UID: \"3ca93cef-6e1c-44ec-9d78-aa1162f80e58\") " pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:22.479482 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.479446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:22.561238 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.561208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdmnh\" (UniqueName: \"kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh\") pod \"kuadrant-operator-catalog-6hhl8\" (UID: \"3ca93cef-6e1c-44ec-9d78-aa1162f80e58\") " pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:22.568636 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.568614    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdmnh\" (UniqueName: \"kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh\") pod \"kuadrant-operator-catalog-6hhl8\" (UID: \"3ca93cef-6e1c-44ec-9d78-aa1162f80e58\") " pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:22.720237 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.720184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:22.843784 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:22.843757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:22.846466 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:47:22.846438    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca93cef_6e1c_44ec_9d78_aa1162f80e58.slice/crio-90af6415639b2a6026705ba9859f1d10361d37db7a8f208cc8562e73cc149d43 WatchSource:0}: Error finding container 90af6415639b2a6026705ba9859f1d10361d37db7a8f208cc8562e73cc149d43: Status 404 returned error can't find the container with id 90af6415639b2a6026705ba9859f1d10361d37db7a8f208cc8562e73cc149d43
Jul 13 03:47:23.000377 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.000332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:23.016259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.016233    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8dkwn"]
Jul 13 03:47:23.019268 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.019247    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:23.027002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.026968    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8dkwn"]
Jul 13 03:47:23.064337 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.064302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g488c\" (UniqueName: \"kubernetes.io/projected/aa1170bd-50f6-4d36-97e0-a741a48cbe83-kube-api-access-g488c\") pod \"kuadrant-operator-catalog-8dkwn\" (UID: \"aa1170bd-50f6-4d36-97e0-a741a48cbe83\") " pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:23.165029 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.164939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g488c\" (UniqueName: \"kubernetes.io/projected/aa1170bd-50f6-4d36-97e0-a741a48cbe83-kube-api-access-g488c\") pod \"kuadrant-operator-catalog-8dkwn\" (UID: \"aa1170bd-50f6-4d36-97e0-a741a48cbe83\") " pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:23.172525 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.172491    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g488c\" (UniqueName: \"kubernetes.io/projected/aa1170bd-50f6-4d36-97e0-a741a48cbe83-kube-api-access-g488c\") pod \"kuadrant-operator-catalog-8dkwn\" (UID: \"aa1170bd-50f6-4d36-97e0-a741a48cbe83\") " pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:23.329911 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.329876    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:23.358053 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.358013    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" event={"ID":"3ca93cef-6e1c-44ec-9d78-aa1162f80e58","Type":"ContainerStarted","Data":"90af6415639b2a6026705ba9859f1d10361d37db7a8f208cc8562e73cc149d43"}
Jul 13 03:47:23.464830 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:23.464613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8dkwn"]
Jul 13 03:47:23.541759 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:47:23.541707    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1170bd_50f6_4d36_97e0_a741a48cbe83.slice/crio-e595af0c98fe0fd6676933b755a556c30d2574cfe54427935cddef7e687b8290 WatchSource:0}: Error finding container e595af0c98fe0fd6676933b755a556c30d2574cfe54427935cddef7e687b8290: Status 404 returned error can't find the container with id e595af0c98fe0fd6676933b755a556c30d2574cfe54427935cddef7e687b8290
Jul 13 03:47:24.366014 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:24.365974    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn" event={"ID":"aa1170bd-50f6-4d36-97e0-a741a48cbe83","Type":"ContainerStarted","Data":"e595af0c98fe0fd6676933b755a556c30d2574cfe54427935cddef7e687b8290"}
Jul 13 03:47:25.371938 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.371901    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn" event={"ID":"aa1170bd-50f6-4d36-97e0-a741a48cbe83","Type":"ContainerStarted","Data":"018f3ff45f22be31671b31666ded81a4c32c8974b075b0c9656c6701547b73aa"}
Jul 13 03:47:25.373312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.373289    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" event={"ID":"3ca93cef-6e1c-44ec-9d78-aa1162f80e58","Type":"ContainerStarted","Data":"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"}
Jul 13 03:47:25.373427 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.373321    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" podUID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" containerName="registry-server" containerID="cri-o://47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda" gracePeriod=2
Jul 13 03:47:25.386865 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.386801    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn" podStartSLOduration=1.234887397 podStartE2EDuration="2.386787738s" totalImagesPullingTime="1.151900341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:47:25.385903593 +0000 UTC m=+364.161617870" watchObservedRunningTime="2026-07-13 03:47:25.386787738 +0000 UTC m=+364.162502016"
Jul 13 03:47:25.399801 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.399748    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" podStartSLOduration=1.648297328 podStartE2EDuration="3.399722559s" totalImagesPullingTime="1.751425231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:47:25.399537766 +0000 UTC m=+364.175252045" watchObservedRunningTime="2026-07-13 03:47:25.399722559 +0000 UTC m=+364.175436846"
Jul 13 03:47:25.623311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.623259    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:25.684092 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.684068    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdmnh\" (UniqueName: \"kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh\") pod \"3ca93cef-6e1c-44ec-9d78-aa1162f80e58\" (UID: \"3ca93cef-6e1c-44ec-9d78-aa1162f80e58\") "
Jul 13 03:47:25.686086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.686054    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh" (OuterVolumeSpecName: "kube-api-access-mdmnh") pod "3ca93cef-6e1c-44ec-9d78-aa1162f80e58" (UID: "3ca93cef-6e1c-44ec-9d78-aa1162f80e58"). InnerVolumeSpecName "kube-api-access-mdmnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:47:25.785489 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:25.785464    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdmnh\" (UniqueName: \"kubernetes.io/projected/3ca93cef-6e1c-44ec-9d78-aa1162f80e58-kube-api-access-mdmnh\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:47:26.378665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.378632    2582 generic.go:356] "Generic (PLEG): container finished" podID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" containerID="47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda" exitCode=0
Jul 13 03:47:26.379117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.378686    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8"
Jul 13 03:47:26.379117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.378718    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" event={"ID":"3ca93cef-6e1c-44ec-9d78-aa1162f80e58","Type":"ContainerDied","Data":"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"}
Jul 13 03:47:26.379117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.378811    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6hhl8" event={"ID":"3ca93cef-6e1c-44ec-9d78-aa1162f80e58","Type":"ContainerDied","Data":"90af6415639b2a6026705ba9859f1d10361d37db7a8f208cc8562e73cc149d43"}
Jul 13 03:47:26.379117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.378832    2582 scope.go:117] "RemoveContainer" containerID="47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"
Jul 13 03:47:26.387059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.387044    2582 scope.go:117] "RemoveContainer" containerID="47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"
Jul 13 03:47:26.387306 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:47:26.387285    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda\": container with ID starting with 47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda not found: ID does not exist" containerID="47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"
Jul 13 03:47:26.387350 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.387312    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda"} err="failed to get container status \"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda\": rpc error: code = NotFound desc = could not find container \"47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda\": container with ID starting with 47bcdccf628e81005518c6f7d5e8d3e0466fda0fc1f3fc87f7b15d108247ccda not found: ID does not exist"
Jul 13 03:47:26.392984 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.392954    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:26.396377 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:26.396357    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6hhl8"]
Jul 13 03:47:27.759398 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:27.759366    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" path="/var/lib/kubelet/pods/3ca93cef-6e1c-44ec-9d78-aa1162f80e58/volumes"
Jul 13 03:47:33.330437 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:33.330402    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:33.330878 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:33.330458    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:33.352018 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:33.351996    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:33.433280 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:33.433244    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8dkwn"
Jul 13 03:47:50.808570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:50.808533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:55.051571 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.051524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:55.750664 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.750630    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"]
Jul 13 03:47:55.750953 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.750940    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" containerName="registry-server"
Jul 13 03:47:55.750999 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.750955    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" containerName="registry-server"
Jul 13 03:47:55.751037 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.751013    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ca93cef-6e1c-44ec-9d78-aa1162f80e58" containerName="registry-server"
Jul 13 03:47:55.754039 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.754010    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:55.756468 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.756444    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cb4fl\""
Jul 13 03:47:55.766270 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.766249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"]
Jul 13 03:47:55.932310 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.932273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfhgd\" (UniqueName: \"kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:55.932492 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:55.932454    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.008021 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.007946    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:56.033133 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.033106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfhgd\" (UniqueName: \"kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.033246 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.033171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.033506 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.033487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.052103 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.052073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfhgd\" (UniqueName: \"kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.063923 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.063903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:47:56.195649 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.195618    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"]
Jul 13 03:47:56.199785 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:47:56.199762    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39013e1_126c_41d8_a091_dbe6a8d4365d.slice/crio-a4da7f5a1ddcdb1756424bc18eb1eb71867ded0f74aca5f608cde3e48e20e930 WatchSource:0}: Error finding container a4da7f5a1ddcdb1756424bc18eb1eb71867ded0f74aca5f608cde3e48e20e930: Status 404 returned error can't find the container with id a4da7f5a1ddcdb1756424bc18eb1eb71867ded0f74aca5f608cde3e48e20e930
Jul 13 03:47:56.414787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.414753    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:56.502680 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:56.502649    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x" event={"ID":"e39013e1-126c-41d8-a091-dbe6a8d4365d","Type":"ContainerStarted","Data":"a4da7f5a1ddcdb1756424bc18eb1eb71867ded0f74aca5f608cde3e48e20e930"}
Jul 13 03:47:57.865397 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:57.865364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:57.962023 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:57.961990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:58.137900 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.137813    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"]
Jul 13 03:47:58.145577 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.145550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:47:58.148004 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.147984    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bvwk5\""
Jul 13 03:47:58.153752 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.152854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"]
Jul 13 03:47:58.253387 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.253344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbf76\" (UniqueName: \"kubernetes.io/projected/a6c1d06f-3732-40c4-b9a1-d7c783566c81-kube-api-access-tbf76\") pod \"authorino-operator-75cc8d5cb7-mwq7p\" (UID: \"a6c1d06f-3732-40c4-b9a1-d7c783566c81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:47:58.354257 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.354225    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbf76\" (UniqueName: \"kubernetes.io/projected/a6c1d06f-3732-40c4-b9a1-d7c783566c81-kube-api-access-tbf76\") pod \"authorino-operator-75cc8d5cb7-mwq7p\" (UID: \"a6c1d06f-3732-40c4-b9a1-d7c783566c81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:47:58.372853 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.372824    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbf76\" (UniqueName: \"kubernetes.io/projected/a6c1d06f-3732-40c4-b9a1-d7c783566c81-kube-api-access-tbf76\") pod \"authorino-operator-75cc8d5cb7-mwq7p\" (UID: \"a6c1d06f-3732-40c4-b9a1-d7c783566c81\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:47:58.461885 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.461796    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:47:58.592706 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:58.592672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"]
Jul 13 03:47:58.595414 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:47:58.595387    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c1d06f_3732_40c4_b9a1_d7c783566c81.slice/crio-1adf1066e8e5485db269553d573c1bd147ebaf541798cee2eaf54d4719f34164 WatchSource:0}: Error finding container 1adf1066e8e5485db269553d573c1bd147ebaf541798cee2eaf54d4719f34164: Status 404 returned error can't find the container with id 1adf1066e8e5485db269553d573c1bd147ebaf541798cee2eaf54d4719f34164
Jul 13 03:47:59.224084 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.224023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:59.519325 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.519230    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p" event={"ID":"a6c1d06f-3732-40c4-b9a1-d7c783566c81","Type":"ContainerStarted","Data":"1adf1066e8e5485db269553d573c1bd147ebaf541798cee2eaf54d4719f34164"}
Jul 13 03:47:59.704298 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.704262    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:59.804957 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.804928    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b8968bfb5-wspnd"]
Jul 13 03:47:59.808674 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.808650    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.820195 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.820175    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8968bfb5-wspnd"]
Jul 13 03:47:59.868661 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.868629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:47:59.969286 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjmx\" (UniqueName: \"kubernetes.io/projected/92a2a977-216a-487a-b8a2-b13565678a29-kube-api-access-wcjmx\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969470 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969470 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-oauth-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969470 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969428    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-trusted-ca-bundle\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969639 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969474    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-console-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969639 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-service-ca\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.969639 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.969572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-oauth-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:47:59.998108 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:47:59.998029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:00.070095 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070005    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-console-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070095 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-service-ca\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-oauth-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070147    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjmx\" (UniqueName: \"kubernetes.io/projected/92a2a977-216a-487a-b8a2-b13565678a29-kube-api-access-wcjmx\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-oauth-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070328 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070242    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-trusted-ca-bundle\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.070886 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070834    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-console-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.071016 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.070957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-service-ca\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.071078 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.071054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-trusted-ca-bundle\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.071188 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.071148    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92a2a977-216a-487a-b8a2-b13565678a29-oauth-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.072974 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.072952    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-serving-cert\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.073231 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.073204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92a2a977-216a-487a-b8a2-b13565678a29-console-oauth-config\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.081311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.081278    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjmx\" (UniqueName: \"kubernetes.io/projected/92a2a977-216a-487a-b8a2-b13565678a29-kube-api-access-wcjmx\") pod \"console-b8968bfb5-wspnd\" (UID: \"92a2a977-216a-487a-b8a2-b13565678a29\") " pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.120287 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.120251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:00.596957 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.596925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:00.697410 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.697376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:00.779699 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.779659    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"]
Jul 13 03:48:00.783355 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.783325    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:00.787048 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.787024    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-x7ll8\""
Jul 13 03:48:00.793097 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.793074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"]
Jul 13 03:48:00.919341 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.919255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:00.978376 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:00.978334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5729c\" (UniqueName: \"kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c\") pod \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" (UID: \"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:01.079740 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:01.079697    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5729c\" (UniqueName: \"kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c\") pod \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" (UID: \"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:01.089214 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:01.089178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5729c\" (UniqueName: \"kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c\") pod \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" (UID: \"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:01.096806 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:01.096775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:01.831264 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:01.831229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:02.129986 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.129897    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"]
Jul 13 03:48:02.133315 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:02.133285    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c0ebd6_fbc0_47d2_8dfd_fbec8a8fc78e.slice/crio-b11f6f6dd98ee3eec41c67f0560aa942c98388f1a569de4e3e932de7f911a281 WatchSource:0}: Error finding container b11f6f6dd98ee3eec41c67f0560aa942c98388f1a569de4e3e932de7f911a281: Status 404 returned error can't find the container with id b11f6f6dd98ee3eec41c67f0560aa942c98388f1a569de4e3e932de7f911a281
Jul 13 03:48:02.154911 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.154822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b8968bfb5-wspnd"]
Jul 13 03:48:02.157237 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:02.157217    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a2a977_216a_487a_b8a2_b13565678a29.slice/crio-8abf71dcbfe35e2444197cd6da7d2d0177f27b0802734f1e776f8cdd16bed6e4 WatchSource:0}: Error finding container 8abf71dcbfe35e2444197cd6da7d2d0177f27b0802734f1e776f8cdd16bed6e4: Status 404 returned error can't find the container with id 8abf71dcbfe35e2444197cd6da7d2d0177f27b0802734f1e776f8cdd16bed6e4
Jul 13 03:48:02.537092 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.537000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8968bfb5-wspnd" event={"ID":"92a2a977-216a-487a-b8a2-b13565678a29","Type":"ContainerStarted","Data":"b8d634f2716ff36642d54f7e79f08e1e70c8102bc542e22c603406682900b402"}
Jul 13 03:48:02.537092 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.537071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b8968bfb5-wspnd" event={"ID":"92a2a977-216a-487a-b8a2-b13565678a29","Type":"ContainerStarted","Data":"8abf71dcbfe35e2444197cd6da7d2d0177f27b0802734f1e776f8cdd16bed6e4"}
Jul 13 03:48:02.538593 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.538562    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x" event={"ID":"e39013e1-126c-41d8-a091-dbe6a8d4365d","Type":"ContainerStarted","Data":"4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7"}
Jul 13 03:48:02.538754 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.538616    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:02.540235 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.540212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p" event={"ID":"a6c1d06f-3732-40c4-b9a1-d7c783566c81","Type":"ContainerStarted","Data":"680d7286393fe5e7375a1f5de4348eec89227811f87d01a06a133396d0d42ae5"}
Jul 13 03:48:02.540841 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.540265    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:48:02.546163 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.546139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z" event={"ID":"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e","Type":"ContainerStarted","Data":"b11f6f6dd98ee3eec41c67f0560aa942c98388f1a569de4e3e932de7f911a281"}
Jul 13 03:48:02.555109 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.555070    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b8968bfb5-wspnd" podStartSLOduration=3.5550595940000003 podStartE2EDuration="3.555059594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:02.553664389 +0000 UTC m=+401.329378668" watchObservedRunningTime="2026-07-13 03:48:02.555059594 +0000 UTC m=+401.330773873"
Jul 13 03:48:02.570580 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.570544    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x" podStartSLOduration=1.776821677 podStartE2EDuration="7.570533109s" totalImagesPullingTime="5.793711432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:02.569633021 +0000 UTC m=+401.345347301" watchObservedRunningTime="2026-07-13 03:48:02.570533109 +0000 UTC m=+401.346247388"
Jul 13 03:48:02.587314 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:02.587272    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p" podStartSLOduration=1.184252335 podStartE2EDuration="4.587261571s" totalImagesPullingTime="3.403009236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:02.585447988 +0000 UTC m=+401.361162266" watchObservedRunningTime="2026-07-13 03:48:02.587261571 +0000 UTC m=+401.362975924"
Jul 13 03:48:03.685698 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:03.685645    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:04.557833 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:04.557798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z" event={"ID":"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e","Type":"ContainerStarted","Data":"87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0"}
Jul 13 03:48:04.558027 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:04.557936    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:04.577087 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:04.577045    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z" podStartSLOduration=2.9201297 podStartE2EDuration="4.57703063s" totalImagesPullingTime="1.65690093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:04.576147568 +0000 UTC m=+403.351861838" watchObservedRunningTime="2026-07-13 03:48:04.57703063 +0000 UTC m=+403.352744908"
Jul 13 03:48:04.985288 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:04.985208    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:05.423372 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:05.423344    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:05.813193 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:05.813162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:05.913544 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:05.913491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:10.121113 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.121074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:10.121548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.121140    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:10.125699 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.125676    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:10.587116 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.587087    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b8968bfb5-wspnd"
Jul 13 03:48:10.632020 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.631989    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:48:10.806323 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.806272    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:10.893660 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:10.893583    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:13.553390 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:13.553362    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:13.553791 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:13.553519    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mwq7p"
Jul 13 03:48:15.169907 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.169868    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"]
Jul 13 03:48:15.170372 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.170121    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" containerName="manager" containerID="cri-o://4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7" gracePeriod=2
Jul 13 03:48:15.176709 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.176677    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"]
Jul 13 03:48:15.179777 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.179708    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e39013e1-126c-41d8-a091-dbe6a8d4365d\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\": pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.187611 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.187577    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"]
Jul 13 03:48:15.187874 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.187822    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" containerName="manager" containerID="cri-o://87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0" gracePeriod=2
Jul 13 03:48:15.190043 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.189993    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.190218 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.190197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.191755 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.190917    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:15.191755 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.191349    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" containerName="manager"
Jul 13 03:48:15.191755 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.191367    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" containerName="manager"
Jul 13 03:48:15.191755 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.191472    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" containerName="manager"
Jul 13 03:48:15.194393 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.194376    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.200904 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.200881    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"]
Jul 13 03:48:15.201804 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.201768    2582 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-nzh6z\": pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.204059 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.203880    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.204443 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.204423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:15.218228 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.218199    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"]
Jul 13 03:48:15.218681 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.218664    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" containerName="manager"
Jul 13 03:48:15.218724 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.218686    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" containerName="manager"
Jul 13 03:48:15.218847 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.218833    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" containerName="manager"
Jul 13 03:48:15.222180 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.222161    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:15.230368 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.230343    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"]
Jul 13 03:48:15.233525 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.233493    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.235565 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.235530    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.253253 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.253217    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.307604 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.307574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.307703 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.307620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fgz6\" (UniqueName: \"kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.307787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.307701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wldvl\" (UniqueName: \"kubernetes.io/projected/afaa03f7-fd7b-47d0-a6ae-cf12c6831524-kube-api-access-wldvl\") pod \"limitador-operator-controller-manager-859d7b78bd-xnh5s\" (UID: \"afaa03f7-fd7b-47d0-a6ae-cf12c6831524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:15.409173 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.409139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.409285 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.409190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fgz6\" (UniqueName: \"kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.409285 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.409229    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wldvl\" (UniqueName: \"kubernetes.io/projected/afaa03f7-fd7b-47d0-a6ae-cf12c6831524-kube-api-access-wldvl\") pod \"limitador-operator-controller-manager-859d7b78bd-xnh5s\" (UID: \"afaa03f7-fd7b-47d0-a6ae-cf12c6831524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:15.409593 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.409570    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.417284 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.417254    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wldvl\" (UniqueName: \"kubernetes.io/projected/afaa03f7-fd7b-47d0-a6ae-cf12c6831524-kube-api-access-wldvl\") pod \"limitador-operator-controller-manager-859d7b78bd-xnh5s\" (UID: \"afaa03f7-fd7b-47d0-a6ae-cf12c6831524\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:15.417394 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.417257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fgz6\" (UniqueName: \"kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2c9wn\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.434990 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.434961    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.436687 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.436670    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.436956 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.436935    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.438584 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.438553    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.440279 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.440257    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.441832 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.441811    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.510447 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.510415    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5729c\" (UniqueName: \"kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c\") pod \"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\" (UID: \"a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e\") "
Jul 13 03:48:15.510447 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.510453    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume\") pod \"e39013e1-126c-41d8-a091-dbe6a8d4365d\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") "
Jul 13 03:48:15.510643 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.510502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfhgd\" (UniqueName: \"kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd\") pod \"e39013e1-126c-41d8-a091-dbe6a8d4365d\" (UID: \"e39013e1-126c-41d8-a091-dbe6a8d4365d\") "
Jul 13 03:48:15.510964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.510939    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e39013e1-126c-41d8-a091-dbe6a8d4365d" (UID: "e39013e1-126c-41d8-a091-dbe6a8d4365d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:48:15.512505 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.512471    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd" (OuterVolumeSpecName: "kube-api-access-mfhgd") pod "e39013e1-126c-41d8-a091-dbe6a8d4365d" (UID: "e39013e1-126c-41d8-a091-dbe6a8d4365d"). InnerVolumeSpecName "kube-api-access-mfhgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:48:15.512589 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.512512    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c" (OuterVolumeSpecName: "kube-api-access-5729c") pod "a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" (UID: "a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e"). InnerVolumeSpecName "kube-api-access-5729c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:48:15.599168 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.599130    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:15.605378 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.605351    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:15.606629 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.606600    2582 generic.go:356] "Generic (PLEG): container finished" podID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" containerID="87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0" exitCode=0
Jul 13 03:48:15.606760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.606651    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.606760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.606694    2582 scope.go:117] "RemoveContainer" containerID="87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0"
Jul 13 03:48:15.608352 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.608242    2582 generic.go:356] "Generic (PLEG): container finished" podID="e39013e1-126c-41d8-a091-dbe6a8d4365d" containerID="4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7" exitCode=0
Jul 13 03:48:15.608352 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.608320    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.608937 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.608906    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.610845 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.610810    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.611075 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.611058    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5729c\" (UniqueName: \"kubernetes.io/projected/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e-kube-api-access-5729c\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:15.611150 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.611081    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e39013e1-126c-41d8-a091-dbe6a8d4365d-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:15.611150 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.611095    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfhgd\" (UniqueName: \"kubernetes.io/projected/e39013e1-126c-41d8-a091-dbe6a8d4365d-kube-api-access-mfhgd\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:15.612666 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.612642    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.614366 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.614343    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.617816 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.617783    2582 scope.go:117] "RemoveContainer" containerID="87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0"
Jul 13 03:48:15.618180 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.618160    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0\": container with ID starting with 87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0 not found: ID does not exist" containerID="87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0"
Jul 13 03:48:15.618264 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.618193    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0"} err="failed to get container status \"87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0\": rpc error: code = NotFound desc = could not find container \"87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0\": container with ID starting with 87e5876da4701695697bbea44717b561a9eee269d9256ef68156a618a3e437b0 not found: ID does not exist"
Jul 13 03:48:15.618264 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.618215    2582 scope.go:117] "RemoveContainer" containerID="4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7"
Jul 13 03:48:15.622538 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.622502    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.626483 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.626446    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.627960 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.627932    2582 scope.go:117] "RemoveContainer" containerID="4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7"
Jul 13 03:48:15.628325 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.628298    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7\": container with ID starting with 4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7 not found: ID does not exist" containerID="4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7"
Jul 13 03:48:15.628419 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.628333    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7"} err="failed to get container status \"4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7\": rpc error: code = NotFound desc = could not find container \"4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7\": container with ID starting with 4c500279eb5546832801813d5e54ff4823dbef8da6e906f1d32175e8d3d473d7 not found: ID does not exist"
Jul 13 03:48:15.628419 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.628344    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-nzh6z\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nzh6z"
Jul 13 03:48:15.630198 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:15.630171    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-pvd9x\" is forbidden: User \"system:node:ip-10-0-141-187.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-187.ec2.internal' and this object" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-pvd9x"
Jul 13 03:48:15.761068 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.760044    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e" path="/var/lib/kubelet/pods/a9c0ebd6-fbc0-47d2-8dfd-fbec8a8fc78e/volumes"
Jul 13 03:48:15.761068 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.760521    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e39013e1-126c-41d8-a091-dbe6a8d4365d" path="/var/lib/kubelet/pods/e39013e1-126c-41d8-a091-dbe6a8d4365d/volumes"
Jul 13 03:48:15.763035 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.763008    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:15.766583 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:15.766554    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcac28ce_7b3a_40ff_a34b_77f235d33b03.slice/crio-18623bb671ce23256942cd720432c0aa7bd1023d7ac6d7661e6d74cd43b205fd WatchSource:0}: Error finding container 18623bb671ce23256942cd720432c0aa7bd1023d7ac6d7661e6d74cd43b205fd: Status 404 returned error can't find the container with id 18623bb671ce23256942cd720432c0aa7bd1023d7ac6d7661e6d74cd43b205fd
Jul 13 03:48:15.768117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:15.768095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"]
Jul 13 03:48:15.770991 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:15.770959    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafaa03f7_fd7b_47d0_a6ae_cf12c6831524.slice/crio-8c90576f4bf95093446c8eda9f195e36a5f70e0625049423daa002ea37e5ad5b WatchSource:0}: Error finding container 8c90576f4bf95093446c8eda9f195e36a5f70e0625049423daa002ea37e5ad5b: Status 404 returned error can't find the container with id 8c90576f4bf95093446c8eda9f195e36a5f70e0625049423daa002ea37e5ad5b
Jul 13 03:48:16.061904 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.061870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:16.135112 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.135082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:16.239383 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.239348    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:16.614432 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.614391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" event={"ID":"bcac28ce-7b3a-40ff-a34b-77f235d33b03","Type":"ContainerStarted","Data":"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"}
Jul 13 03:48:16.614625 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.614471    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" event={"ID":"bcac28ce-7b3a-40ff-a34b-77f235d33b03","Type":"ContainerStarted","Data":"18623bb671ce23256942cd720432c0aa7bd1023d7ac6d7661e6d74cd43b205fd"}
Jul 13 03:48:16.614625 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.614502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:16.617886 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.617859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s" event={"ID":"afaa03f7-fd7b-47d0-a6ae-cf12c6831524","Type":"ContainerStarted","Data":"eb009d44c56270d6d66e95164184f541c25df2816c71d00fbbe988979436c402"}
Jul 13 03:48:16.617990 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.617898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s" event={"ID":"afaa03f7-fd7b-47d0-a6ae-cf12c6831524","Type":"ContainerStarted","Data":"8c90576f4bf95093446c8eda9f195e36a5f70e0625049423daa002ea37e5ad5b"}
Jul 13 03:48:16.617990 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.617929    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:16.636276 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.636223    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" podStartSLOduration=1.636208771 podStartE2EDuration="1.636208771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:16.635948743 +0000 UTC m=+415.411663023" watchObservedRunningTime="2026-07-13 03:48:16.636208771 +0000 UTC m=+415.411923050"
Jul 13 03:48:16.652869 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:16.652817    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s" podStartSLOduration=1.652801894 podStartE2EDuration="1.652801894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:16.651998889 +0000 UTC m=+415.427713166" watchObservedRunningTime="2026-07-13 03:48:16.652801894 +0000 UTC m=+415.428516172"
Jul 13 03:48:19.031561 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:19.031530    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:19.132162 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:19.132132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:21.474429 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:21.474395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:21.531459 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:21.531425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:27.229963 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:27.229925    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:27.330843 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:27.330809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:27.625372 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:27.625341    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:27.625567 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:27.625421    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xnh5s"
Jul 13 03:48:33.109342 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.109305    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:33.109818 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.109562    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" podUID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" containerName="manager" containerID="cri-o://d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d" gracePeriod=10
Jul 13 03:48:33.850178 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.850155    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:33.966408 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.966317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume\") pod \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") "
Jul 13 03:48:33.966408 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.966402    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fgz6\" (UniqueName: \"kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6\") pod \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\" (UID: \"bcac28ce-7b3a-40ff-a34b-77f235d33b03\") "
Jul 13 03:48:33.966663 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.966642    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bcac28ce-7b3a-40ff-a34b-77f235d33b03" (UID: "bcac28ce-7b3a-40ff-a34b-77f235d33b03"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 03:48:33.968397 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:33.968376    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6" (OuterVolumeSpecName: "kube-api-access-9fgz6") pod "bcac28ce-7b3a-40ff-a34b-77f235d33b03" (UID: "bcac28ce-7b3a-40ff-a34b-77f235d33b03"). InnerVolumeSpecName "kube-api-access-9fgz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:48:34.067340 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.067304    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcac28ce-7b3a-40ff-a34b-77f235d33b03-extensions-socket-volume\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:34.067340 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.067333    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fgz6\" (UniqueName: \"kubernetes.io/projected/bcac28ce-7b3a-40ff-a34b-77f235d33b03-kube-api-access-9fgz6\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:34.699542 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.699505    2582 generic.go:356] "Generic (PLEG): container finished" podID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" containerID="d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d" exitCode=0
Jul 13 03:48:34.700025 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.699554    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"
Jul 13 03:48:34.700025 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.699593    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" event={"ID":"bcac28ce-7b3a-40ff-a34b-77f235d33b03","Type":"ContainerDied","Data":"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"}
Jul 13 03:48:34.700025 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.699648    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn" event={"ID":"bcac28ce-7b3a-40ff-a34b-77f235d33b03","Type":"ContainerDied","Data":"18623bb671ce23256942cd720432c0aa7bd1023d7ac6d7661e6d74cd43b205fd"}
Jul 13 03:48:34.700025 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.699671    2582 scope.go:117] "RemoveContainer" containerID="d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"
Jul 13 03:48:34.708601 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.708585    2582 scope.go:117] "RemoveContainer" containerID="d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"
Jul 13 03:48:34.708892 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:34.708870    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d\": container with ID starting with d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d not found: ID does not exist" containerID="d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"
Jul 13 03:48:34.708985 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.708898    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d"} err="failed to get container status \"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d\": rpc error: code = NotFound desc = could not find container \"d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d\": container with ID starting with d8467258c47fb08efd2712d6f2a0d860cca796c018625836e87fa67bbd7ce11d not found: ID does not exist"
Jul 13 03:48:34.719718 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.719696    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:34.723639 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:34.723618    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2c9wn"]
Jul 13 03:48:35.659142 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.659080    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-545c864c7-xtv6m" podUID="c149f7ec-eec2-43e1-b917-9167632a1d90" containerName="console" containerID="cri-o://f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f" gracePeriod=15
Jul 13 03:48:35.759995 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.759963    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" path="/var/lib/kubelet/pods/bcac28ce-7b3a-40ff-a34b-77f235d33b03/volumes"
Jul 13 03:48:35.906622 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.906598    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:48:35.983696 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983696 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983696 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983693    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983792    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2th8m\" (UniqueName: \"kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983814    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.983987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.983846    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config\") pod \"c149f7ec-eec2-43e1-b917-9167632a1d90\" (UID: \"c149f7ec-eec2-43e1-b917-9167632a1d90\") "
Jul 13 03:48:35.984166 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984070    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:48:35.984166 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca" (OuterVolumeSpecName: "service-ca") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:48:35.984267 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984214    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:48:35.984324 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984283    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config" (OuterVolumeSpecName: "console-config") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:48:35.984324 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984295    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-trusted-ca-bundle\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:35.984324 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984318    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:35.984451 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.984333    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-oauth-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:35.986065 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.986030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:48:35.986065 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.986055    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:48:35.986216 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:35.986110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m" (OuterVolumeSpecName: "kube-api-access-2th8m") pod "c149f7ec-eec2-43e1-b917-9167632a1d90" (UID: "c149f7ec-eec2-43e1-b917-9167632a1d90"). InnerVolumeSpecName "kube-api-access-2th8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:48:36.085018 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.084981    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2th8m\" (UniqueName: \"kubernetes.io/projected/c149f7ec-eec2-43e1-b917-9167632a1d90-kube-api-access-2th8m\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:36.085018 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.085022    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-serving-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:36.085214 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.085034    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c149f7ec-eec2-43e1-b917-9167632a1d90-console-oauth-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:36.085214 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.085043    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c149f7ec-eec2-43e1-b917-9167632a1d90-console-config\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:48:36.711356 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.711325    2582 generic.go:356] "Generic (PLEG): container finished" podID="c149f7ec-eec2-43e1-b917-9167632a1d90" containerID="f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f" exitCode=0
Jul 13 03:48:36.711548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.711365    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-545c864c7-xtv6m"
Jul 13 03:48:36.711548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.711410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545c864c7-xtv6m" event={"ID":"c149f7ec-eec2-43e1-b917-9167632a1d90","Type":"ContainerDied","Data":"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"}
Jul 13 03:48:36.711548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.711466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-545c864c7-xtv6m" event={"ID":"c149f7ec-eec2-43e1-b917-9167632a1d90","Type":"ContainerDied","Data":"8126da2b0f20e60a09c9bc671d818b708aa07807b8a40ed99d1ebc8f44af2152"}
Jul 13 03:48:36.711548 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.711494    2582 scope.go:117] "RemoveContainer" containerID="f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"
Jul 13 03:48:36.725507 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.725485    2582 scope.go:117] "RemoveContainer" containerID="f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"
Jul 13 03:48:36.725787 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:48:36.725767    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f\": container with ID starting with f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f not found: ID does not exist" containerID="f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"
Jul 13 03:48:36.725846 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.725802    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f"} err="failed to get container status \"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f\": rpc error: code = NotFound desc = could not find container \"f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f\": container with ID starting with f50b3fe19ffc7d6017a3b5b166e0950de7b1a426120987328ae68d06baa5bc4f not found: ID does not exist"
Jul 13 03:48:36.734885 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.734863    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:48:36.738247 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:36.738228    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-545c864c7-xtv6m"]
Jul 13 03:48:37.626863 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:37.626830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:37.726239 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:37.726209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:37.760338 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:37.760310    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c149f7ec-eec2-43e1-b917-9167632a1d90" path="/var/lib/kubelet/pods/c149f7ec-eec2-43e1-b917-9167632a1d90/volumes"
Jul 13 03:48:38.025596 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:38.025509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:38.125856 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:38.125800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:41.226311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:41.226276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:41.326751 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:41.326709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:42.824113 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:42.824074    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:42.925490 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:42.925462    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:49.402117 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.402043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:49.450416 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450380    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"]
Jul 13 03:48:49.450694 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450683    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" containerName="manager"
Jul 13 03:48:49.450760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450696    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" containerName="manager"
Jul 13 03:48:49.450760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450710    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c149f7ec-eec2-43e1-b917-9167632a1d90" containerName="console"
Jul 13 03:48:49.450760 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450715    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c149f7ec-eec2-43e1-b917-9167632a1d90" containerName="console"
Jul 13 03:48:49.450857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450800    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcac28ce-7b3a-40ff-a34b-77f235d33b03" containerName="manager"
Jul 13 03:48:49.450857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.450810    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c149f7ec-eec2-43e1-b917-9167632a1d90" containerName="console"
Jul 13 03:48:49.452586 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.452570    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.460064 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.460038    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kl6mq\""
Jul 13 03:48:49.472991 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.472961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"]
Jul 13 03:48:49.586076 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d6nv\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-kube-api-access-9d6nv\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586256    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586277 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.586622 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.586288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea189d5-50d2-4844-adc7-c6603860bd8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.656895 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.656805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:49.686937 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.686904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687103 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.686947    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687103 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.686966    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687103 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d6nv\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-kube-api-access-9d6nv\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687140    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687212    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea189d5-50d2-4844-adc7-c6603860bd8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687455 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687331    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687455 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687374    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687455 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687569 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687607 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687581    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.687917 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.687895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ea189d5-50d2-4844-adc7-c6603860bd8f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.689456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.689429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.689595 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.689580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.694933 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.694912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.695133 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.695111    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d6nv\" (UniqueName: \"kubernetes.io/projected/4ea189d5-50d2-4844-adc7-c6603860bd8f-kube-api-access-9d6nv\") pod \"maas-default-gateway-openshift-default-56654dcf7-7wqp5\" (UID: \"4ea189d5-50d2-4844-adc7-c6603860bd8f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.767099 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.767064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:49.894543 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.894522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"]
Jul 13 03:48:49.896537 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:49.896513    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ea189d5_50d2_4844_adc7_c6603860bd8f.slice/crio-0af347e56e67f5b5eda964d4ef4341a1102da215f2504cdebf3311a0f1d9633f WatchSource:0}: Error finding container 0af347e56e67f5b5eda964d4ef4341a1102da215f2504cdebf3311a0f1d9633f: Status 404 returned error can't find the container with id 0af347e56e67f5b5eda964d4ef4341a1102da215f2504cdebf3311a0f1d9633f
Jul 13 03:48:49.898653 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.898620    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:48:49.898772 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.898682    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:48:49.898772 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:49.898709    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:48:50.773912 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:50.773878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" event={"ID":"4ea189d5-50d2-4844-adc7-c6603860bd8f","Type":"ContainerStarted","Data":"4b139e9c924e044e4fe0a998a54ea177e852eba8ae11119b22633301b464f1e1"}
Jul 13 03:48:50.774300 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:50.773926    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" event={"ID":"4ea189d5-50d2-4844-adc7-c6603860bd8f","Type":"ContainerStarted","Data":"0af347e56e67f5b5eda964d4ef4341a1102da215f2504cdebf3311a0f1d9633f"}
Jul 13 03:48:50.794252 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:50.794207    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" podStartSLOduration=1.794193031 podStartE2EDuration="1.794193031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:50.792184561 +0000 UTC m=+449.567898850" watchObservedRunningTime="2026-07-13 03:48:50.794193031 +0000 UTC m=+449.569907314"
Jul 13 03:48:51.722683 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.722653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:51.723128 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.723109    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:48:51.725376 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.725358    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.727537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.727516    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-s9h8z\""
Jul 13 03:48:51.727652 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.727519    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 13 03:48:51.735633 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.735614    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:48:51.767524 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.767500    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:51.771826 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.771805    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:51.777713 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.777696    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:51.778456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.778441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:48:51.804293 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.804254    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tk4h\" (UniqueName: \"kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.804471 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.804407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.824040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.824005    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:48:51.843768 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.843723    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:51.902691 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.902657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:51.904849 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.904826    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tk4h\" (UniqueName: \"kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.904950 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.904867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.905415 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.905397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:51.912169 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:51.912145    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tk4h\" (UniqueName: \"kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h\") pod \"limitador-limitador-64c94fd64f-zp5q4\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:52.035497 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.035415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:52.166190 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.166167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:48:52.168888 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:52.168865    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac7931d_1b17_4f9e_8dbc_030a2649fdea.slice/crio-bd64dce8ad4bfc9bb2fc2a9e3e29ab4e64ecbfe0ff878f7988b9554831dbaa4e WatchSource:0}: Error finding container bd64dce8ad4bfc9bb2fc2a9e3e29ab4e64ecbfe0ff878f7988b9554831dbaa4e: Status 404 returned error can't find the container with id bd64dce8ad4bfc9bb2fc2a9e3e29ab4e64ecbfe0ff878f7988b9554831dbaa4e
Jul 13 03:48:52.521172 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.521138    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:48:52.524137 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.524116    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:48:52.526381 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.526345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zq7lr\""
Jul 13 03:48:52.531637 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.531608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:48:52.554107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.554079    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:52.606084 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.606056    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:48:52.609314 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.609293    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfzn8\" (UniqueName: \"kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8\") pod \"authorino-58cd955675-w8rsz\" (UID: \"3d46034b-d65e-40cc-bfe7-1db42217b261\") " pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:48:52.627336 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.627316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:48:52.629473 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.629455    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:48:52.638410 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.638380    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:48:52.710775 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.710718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfzn8\" (UniqueName: \"kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8\") pod \"authorino-58cd955675-w8rsz\" (UID: \"3d46034b-d65e-40cc-bfe7-1db42217b261\") " pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:48:52.710935 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.710817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqz5x\" (UniqueName: \"kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x\") pod \"authorino-75d556bd77-7gmhx\" (UID: \"fe5bba66-fcb2-47fb-b6f3-057ec290615a\") " pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:48:52.717979 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.717954    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfzn8\" (UniqueName: \"kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8\") pod \"authorino-58cd955675-w8rsz\" (UID: \"3d46034b-d65e-40cc-bfe7-1db42217b261\") " pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:48:52.782969 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.782888    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" event={"ID":"5ac7931d-1b17-4f9e-8dbc-030a2649fdea","Type":"ContainerStarted","Data":"bd64dce8ad4bfc9bb2fc2a9e3e29ab4e64ecbfe0ff878f7988b9554831dbaa4e"}
Jul 13 03:48:52.812152 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.812123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqz5x\" (UniqueName: \"kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x\") pod \"authorino-75d556bd77-7gmhx\" (UID: \"fe5bba66-fcb2-47fb-b6f3-057ec290615a\") " pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:48:52.819686 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.819661    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqz5x\" (UniqueName: \"kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x\") pod \"authorino-75d556bd77-7gmhx\" (UID: \"fe5bba66-fcb2-47fb-b6f3-057ec290615a\") " pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:48:52.833483 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.833462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:48:52.939331 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.939303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:48:52.957275 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:52.957242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:48:52.960993 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:48:52.960868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d46034b_d65e_40cc_bfe7_1db42217b261.slice/crio-406914bc07705845a2cd8206849171042d4f6b8829f12066a182965c19fd00df WatchSource:0}: Error finding container 406914bc07705845a2cd8206849171042d4f6b8829f12066a182965c19fd00df: Status 404 returned error can't find the container with id 406914bc07705845a2cd8206849171042d4f6b8829f12066a182965c19fd00df
Jul 13 03:48:53.069890 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:53.069847    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:48:53.798360 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:53.798318    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w8rsz" event={"ID":"3d46034b-d65e-40cc-bfe7-1db42217b261","Type":"ContainerStarted","Data":"406914bc07705845a2cd8206849171042d4f6b8829f12066a182965c19fd00df"}
Jul 13 03:48:53.800011 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:53.799952    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gmhx" event={"ID":"fe5bba66-fcb2-47fb-b6f3-057ec290615a","Type":"ContainerStarted","Data":"08b5627abdee3b5af0c3ff47b5ae5b286d5eadd51bcf54e65a1f9e83418dbc45"}
Jul 13 03:48:57.835291 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.835254    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" event={"ID":"5ac7931d-1b17-4f9e-8dbc-030a2649fdea","Type":"ContainerStarted","Data":"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"}
Jul 13 03:48:57.835765 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.835428    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:48:57.836787 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.836761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w8rsz" event={"ID":"3d46034b-d65e-40cc-bfe7-1db42217b261","Type":"ContainerStarted","Data":"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"}
Jul 13 03:48:57.838038 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.838014    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gmhx" event={"ID":"fe5bba66-fcb2-47fb-b6f3-057ec290615a","Type":"ContainerStarted","Data":"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"}
Jul 13 03:48:57.851113 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.851067    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" podStartSLOduration=1.478577122 podStartE2EDuration="6.851052327s" totalImagesPullingTime="5.372475205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:57.849030211 +0000 UTC m=+456.624744489" watchObservedRunningTime="2026-07-13 03:48:57.851052327 +0000 UTC m=+456.626766606"
Jul 13 03:48:57.862516 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.862395    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-w8rsz" podStartSLOduration=1.291308865 podStartE2EDuration="5.862377068s" totalImagesPullingTime="4.571068203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:57.861491819 +0000 UTC m=+456.637206097" watchObservedRunningTime="2026-07-13 03:48:57.862377068 +0000 UTC m=+456.638091350"
Jul 13 03:48:57.875246 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.875198    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-7gmhx" podStartSLOduration=1.415722845 podStartE2EDuration="5.875181136s" totalImagesPullingTime="4.459458291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:48:57.873400973 +0000 UTC m=+456.649115253" watchObservedRunningTime="2026-07-13 03:48:57.875181136 +0000 UTC m=+456.650895414"
Jul 13 03:48:57.897574 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:57.897533    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:48:59.847456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:48:59.847415    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-w8rsz" podUID="3d46034b-d65e-40cc-bfe7-1db42217b261" containerName="authorino" containerID="cri-o://10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a" gracePeriod=30
Jul 13 03:49:00.099791 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.099719    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:49:00.180456 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.180423    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfzn8\" (UniqueName: \"kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8\") pod \"3d46034b-d65e-40cc-bfe7-1db42217b261\" (UID: \"3d46034b-d65e-40cc-bfe7-1db42217b261\") "
Jul 13 03:49:00.182489 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.182460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8" (OuterVolumeSpecName: "kube-api-access-kfzn8") pod "3d46034b-d65e-40cc-bfe7-1db42217b261" (UID: "3d46034b-d65e-40cc-bfe7-1db42217b261"). InnerVolumeSpecName "kube-api-access-kfzn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:49:00.281966 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.281930    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfzn8\" (UniqueName: \"kubernetes.io/projected/3d46034b-d65e-40cc-bfe7-1db42217b261-kube-api-access-kfzn8\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:49:00.853570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.853533    2582 generic.go:356] "Generic (PLEG): container finished" podID="3d46034b-d65e-40cc-bfe7-1db42217b261" containerID="10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a" exitCode=0
Jul 13 03:49:00.853964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.853576    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-w8rsz"
Jul 13 03:49:00.853964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.853621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w8rsz" event={"ID":"3d46034b-d65e-40cc-bfe7-1db42217b261","Type":"ContainerDied","Data":"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"}
Jul 13 03:49:00.853964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.853668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-w8rsz" event={"ID":"3d46034b-d65e-40cc-bfe7-1db42217b261","Type":"ContainerDied","Data":"406914bc07705845a2cd8206849171042d4f6b8829f12066a182965c19fd00df"}
Jul 13 03:49:00.853964 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.853687    2582 scope.go:117] "RemoveContainer" containerID="10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"
Jul 13 03:49:00.861781 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.861766    2582 scope.go:117] "RemoveContainer" containerID="10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"
Jul 13 03:49:00.862019 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:00.862004    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a\": container with ID starting with 10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a not found: ID does not exist" containerID="10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"
Jul 13 03:49:00.862057 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.862026    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a"} err="failed to get container status \"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a\": rpc error: code = NotFound desc = could not find container \"10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a\": container with ID starting with 10d8d7bf2dbff7bd9a8244540a5ecf2711d5044a8bc02ce19d41d83354b61e6a not found: ID does not exist"
Jul 13 03:49:00.872457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.872436    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:49:00.875988 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:00.875968    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-w8rsz"]
Jul 13 03:49:01.760557 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:01.760527    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d46034b-d65e-40cc-bfe7-1db42217b261" path="/var/lib/kubelet/pods/3d46034b-d65e-40cc-bfe7-1db42217b261/volumes"
Jul 13 03:49:07.405918 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:07.405888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:07.943700 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:07.943663    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:49:07.943888 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:07.943864    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" podUID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" containerName="limitador" containerID="cri-o://7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e" gracePeriod=30
Jul 13 03:49:07.944534 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:07.944503    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:49:08.486827 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.485576    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:49:08.550921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.550822    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file\") pod \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") "
Jul 13 03:49:08.550921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.550869    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tk4h\" (UniqueName: \"kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h\") pod \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\" (UID: \"5ac7931d-1b17-4f9e-8dbc-030a2649fdea\") "
Jul 13 03:49:08.551274 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.551246    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file" (OuterVolumeSpecName: "config-file") pod "5ac7931d-1b17-4f9e-8dbc-030a2649fdea" (UID: "5ac7931d-1b17-4f9e-8dbc-030a2649fdea"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 03:49:08.552921 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.552900    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h" (OuterVolumeSpecName: "kube-api-access-7tk4h") pod "5ac7931d-1b17-4f9e-8dbc-030a2649fdea" (UID: "5ac7931d-1b17-4f9e-8dbc-030a2649fdea"). InnerVolumeSpecName "kube-api-access-7tk4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:49:08.651421 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.651386    2582 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-config-file\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:49:08.651421 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.651417    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tk4h\" (UniqueName: \"kubernetes.io/projected/5ac7931d-1b17-4f9e-8dbc-030a2649fdea-kube-api-access-7tk4h\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:49:08.896478 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.896444    2582 generic.go:356] "Generic (PLEG): container finished" podID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" containerID="7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e" exitCode=0
Jul 13 03:49:08.896678 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.896490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" event={"ID":"5ac7931d-1b17-4f9e-8dbc-030a2649fdea","Type":"ContainerDied","Data":"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"}
Jul 13 03:49:08.896678 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.896496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"
Jul 13 03:49:08.896678 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.896532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zp5q4" event={"ID":"5ac7931d-1b17-4f9e-8dbc-030a2649fdea","Type":"ContainerDied","Data":"bd64dce8ad4bfc9bb2fc2a9e3e29ab4e64ecbfe0ff878f7988b9554831dbaa4e"}
Jul 13 03:49:08.896678 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.896553    2582 scope.go:117] "RemoveContainer" containerID="7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"
Jul 13 03:49:08.905109 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.905091    2582 scope.go:117] "RemoveContainer" containerID="7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"
Jul 13 03:49:08.905379 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:08.905359    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e\": container with ID starting with 7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e not found: ID does not exist" containerID="7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"
Jul 13 03:49:08.905438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.905388    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e"} err="failed to get container status \"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e\": rpc error: code = NotFound desc = could not find container \"7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e\": container with ID starting with 7ccafc6cdd96a3b6e66b07b78a623c6fa9ffdc03a2034e97b61cdb3ca9077c3e not found: ID does not exist"
Jul 13 03:49:08.916004 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.915974    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:49:08.919149 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:08.919127    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zp5q4"]
Jul 13 03:49:09.759554 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:09.759522    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" path="/var/lib/kubelet/pods/5ac7931d-1b17-4f9e-8dbc-030a2649fdea/volumes"
Jul 13 03:49:12.925090 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:12.925057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:13.023942 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.023911    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:13.357438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357405    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"]
Jul 13 03:49:13.357781 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357767    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" containerName="limitador"
Jul 13 03:49:13.357829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357782    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" containerName="limitador"
Jul 13 03:49:13.357829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357792    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d46034b-d65e-40cc-bfe7-1db42217b261" containerName="authorino"
Jul 13 03:49:13.357829 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357797    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d46034b-d65e-40cc-bfe7-1db42217b261" containerName="authorino"
Jul 13 03:49:13.357920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357847    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d46034b-d65e-40cc-bfe7-1db42217b261" containerName="authorino"
Jul 13 03:49:13.357920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.357854    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac7931d-1b17-4f9e-8dbc-030a2649fdea" containerName="limitador"
Jul 13 03:49:13.362125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.362106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.364537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.364512    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 13 03:49:13.364537 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.364522    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 13 03:49:13.364747 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.364629    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xl9z8\""
Jul 13 03:49:13.364849 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.364757    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 13 03:49:13.368914 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.368889    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"]
Jul 13 03:49:13.389059 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.389009    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:13.497509 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.497476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac377c39-00e8-48a9-8f79-7b5c89948e18-data\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.497679 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.497518    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp7wr\" (UniqueName: \"kubernetes.io/projected/ac377c39-00e8-48a9-8f79-7b5c89948e18-kube-api-access-jp7wr\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.598259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.598211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac377c39-00e8-48a9-8f79-7b5c89948e18-data\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.598259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.598267    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp7wr\" (UniqueName: \"kubernetes.io/projected/ac377c39-00e8-48a9-8f79-7b5c89948e18-kube-api-access-jp7wr\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.598596 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.598576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ac377c39-00e8-48a9-8f79-7b5c89948e18-data\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.606160 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.606133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp7wr\" (UniqueName: \"kubernetes.io/projected/ac377c39-00e8-48a9-8f79-7b5c89948e18-kube-api-access-jp7wr\") pod \"postgres-69fb4594cf-h2wpx\" (UID: \"ac377c39-00e8-48a9-8f79-7b5c89948e18\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.673462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.673382    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:13.800857 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.800833    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"]
Jul 13 03:49:13.803208 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:49:13.803180    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac377c39_00e8_48a9_8f79_7b5c89948e18.slice/crio-ea5096d79851a18e13cd848262236db7a8fd6a20bbf6b44eebb398606b154218 WatchSource:0}: Error finding container ea5096d79851a18e13cd848262236db7a8fd6a20bbf6b44eebb398606b154218: Status 404 returned error can't find the container with id ea5096d79851a18e13cd848262236db7a8fd6a20bbf6b44eebb398606b154218
Jul 13 03:49:13.920462 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:13.920427    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx" event={"ID":"ac377c39-00e8-48a9-8f79-7b5c89948e18","Type":"ContainerStarted","Data":"ea5096d79851a18e13cd848262236db7a8fd6a20bbf6b44eebb398606b154218"}
Jul 13 03:49:19.953879 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:19.953842    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx" event={"ID":"ac377c39-00e8-48a9-8f79-7b5c89948e18","Type":"ContainerStarted","Data":"95ca5ec7a59b814d5b66956f894f07e0661d9cda93fae120bb8a5e7438e745cb"}
Jul 13 03:49:19.954263 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:19.953973    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:19.968573 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:19.968524    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx" podStartSLOduration=1.7520527719999999 podStartE2EDuration="6.968509118s" totalImagesPullingTime="5.216456346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:49:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:49:19.967773252 +0000 UTC m=+478.743487532" watchObservedRunningTime="2026-07-13 03:49:19.968509118 +0000 UTC m=+478.744223396"
Jul 13 03:49:24.812173 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:24.812139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:24.912027 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:24.911994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:25.987048 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:25.987017    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h2wpx"
Jul 13 03:49:26.295394 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.295301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:26.518780 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.518736    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:26.522083 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.522067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:26.528149 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.528122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:26.620086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.620055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhbl\" (UniqueName: \"kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl\") pod \"authorino-5d4b67c446-b2jpp\" (UID: \"192e872e-94d0-473a-8aad-3886afdf313d\") " pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:26.720665 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.720629    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhbl\" (UniqueName: \"kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl\") pod \"authorino-5d4b67c446-b2jpp\" (UID: \"192e872e-94d0-473a-8aad-3886afdf313d\") " pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:26.727872 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.727846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhbl\" (UniqueName: \"kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl\") pod \"authorino-5d4b67c446-b2jpp\" (UID: \"192e872e-94d0-473a-8aad-3886afdf313d\") " pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:26.745565 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.745542    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:26.745786 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.745773    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:26.760289 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.760265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:26.869430 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.869314    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:26.872084 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:49:26.872020    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod192e872e_94d0_473a_8aad_3886afdf313d.slice/crio-1876e618eb4efad3424ea2415024df90240b04768e469a4040c0ddbc4d70ff16 WatchSource:0}: Error finding container 1876e618eb4efad3424ea2415024df90240b04768e469a4040c0ddbc4d70ff16: Status 404 returned error can't find the container with id 1876e618eb4efad3424ea2415024df90240b04768e469a4040c0ddbc4d70ff16
Jul 13 03:49:26.985339 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:26.985306    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" event={"ID":"192e872e-94d0-473a-8aad-3886afdf313d","Type":"ContainerStarted","Data":"1876e618eb4efad3424ea2415024df90240b04768e469a4040c0ddbc4d70ff16"}
Jul 13 03:49:27.028913 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.028886    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:49:27.033311 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.033293    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.035614 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.035595    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 13 03:49:27.038553 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.038529    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:49:27.123617 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.123524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.123617 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.123579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4s9\" (UniqueName: \"kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.224967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.224937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4s9\" (UniqueName: \"kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.225120 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.225011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.227281 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.227262    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.232115 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.232097    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4s9\" (UniqueName: \"kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9\") pod \"authorino-6f558dfdfb-f8r27\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") " pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.343836 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.343800    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:49:27.473024 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.472989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:49:27.475611 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:49:27.475587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70a025cb_b570_4972_8479_494beeb69722.slice/crio-d64e68dcde4459dee90016ac000f3058ee3be7920172e530ee0e6c04cd6a119d WatchSource:0}: Error finding container d64e68dcde4459dee90016ac000f3058ee3be7920172e530ee0e6c04cd6a119d: Status 404 returned error can't find the container with id d64e68dcde4459dee90016ac000f3058ee3be7920172e530ee0e6c04cd6a119d
Jul 13 03:49:27.991599 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.991568    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" event={"ID":"192e872e-94d0-473a-8aad-3886afdf313d","Type":"ContainerStarted","Data":"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"}
Jul 13 03:49:27.991810 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.991596    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" podUID="192e872e-94d0-473a-8aad-3886afdf313d" containerName="authorino" containerID="cri-o://497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846" gracePeriod=30
Jul 13 03:49:27.993125 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.993103    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" event={"ID":"70a025cb-b570-4972-8479-494beeb69722","Type":"ContainerStarted","Data":"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"}
Jul 13 03:49:27.993229 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:27.993136    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" event={"ID":"70a025cb-b570-4972-8479-494beeb69722","Type":"ContainerStarted","Data":"d64e68dcde4459dee90016ac000f3058ee3be7920172e530ee0e6c04cd6a119d"}
Jul 13 03:49:28.005465 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.005426    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" podStartSLOduration=1.4794338759999999 podStartE2EDuration="2.005411536s" totalImagesPullingTime="525.97766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:49:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:49:28.004908746 +0000 UTC m=+486.780623024" watchObservedRunningTime="2026-07-13 03:49:28.005411536 +0000 UTC m=+486.781125816"
Jul 13 03:49:28.020367 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.020331    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" podStartSLOduration=0.665360352 podStartE2EDuration="1.020318748s" totalImagesPullingTime="354.958396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:49:28.019418072 +0000 UTC m=+486.795132363" watchObservedRunningTime="2026-07-13 03:49:28.020318748 +0000 UTC m=+486.796033027"
Jul 13 03:49:28.045080 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.045053    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:49:28.045757 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.045256    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-7gmhx" podUID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" containerName="authorino" containerID="cri-o://f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476" gracePeriod=30
Jul 13 03:49:28.297718 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.297694    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:28.303393 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.303375    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:49:28.437455 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.437381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frhbl\" (UniqueName: \"kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl\") pod \"192e872e-94d0-473a-8aad-3886afdf313d\" (UID: \"192e872e-94d0-473a-8aad-3886afdf313d\") "
Jul 13 03:49:28.437612 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.437514    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqz5x\" (UniqueName: \"kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x\") pod \"fe5bba66-fcb2-47fb-b6f3-057ec290615a\" (UID: \"fe5bba66-fcb2-47fb-b6f3-057ec290615a\") "
Jul 13 03:49:28.439316 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.439283    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl" (OuterVolumeSpecName: "kube-api-access-frhbl") pod "192e872e-94d0-473a-8aad-3886afdf313d" (UID: "192e872e-94d0-473a-8aad-3886afdf313d"). InnerVolumeSpecName "kube-api-access-frhbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:49:28.439426 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.439359    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x" (OuterVolumeSpecName: "kube-api-access-mqz5x") pod "fe5bba66-fcb2-47fb-b6f3-057ec290615a" (UID: "fe5bba66-fcb2-47fb-b6f3-057ec290615a"). InnerVolumeSpecName "kube-api-access-mqz5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:49:28.539002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.538973    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqz5x\" (UniqueName: \"kubernetes.io/projected/fe5bba66-fcb2-47fb-b6f3-057ec290615a-kube-api-access-mqz5x\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:49:28.539002 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.538997    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frhbl\" (UniqueName: \"kubernetes.io/projected/192e872e-94d0-473a-8aad-3886afdf313d-kube-api-access-frhbl\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:49:28.998770 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.998660    2582 generic.go:356] "Generic (PLEG): container finished" podID="192e872e-94d0-473a-8aad-3886afdf313d" containerID="497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846" exitCode=0
Jul 13 03:49:28.998770 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.998703    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-b2jpp"
Jul 13 03:49:28.998770 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.998706    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" event={"ID":"192e872e-94d0-473a-8aad-3886afdf313d","Type":"ContainerDied","Data":"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"}
Jul 13 03:49:28.999050 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.998778    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-b2jpp" event={"ID":"192e872e-94d0-473a-8aad-3886afdf313d","Type":"ContainerDied","Data":"1876e618eb4efad3424ea2415024df90240b04768e469a4040c0ddbc4d70ff16"}
Jul 13 03:49:28.999050 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:28.998802    2582 scope.go:117] "RemoveContainer" containerID="497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"
Jul 13 03:49:29.000151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.000054    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" containerID="f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476" exitCode=0
Jul 13 03:49:29.000151 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.000119    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-7gmhx"
Jul 13 03:49:29.000259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.000153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gmhx" event={"ID":"fe5bba66-fcb2-47fb-b6f3-057ec290615a","Type":"ContainerDied","Data":"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"}
Jul 13 03:49:29.000259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.000183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-7gmhx" event={"ID":"fe5bba66-fcb2-47fb-b6f3-057ec290615a","Type":"ContainerDied","Data":"08b5627abdee3b5af0c3ff47b5ae5b286d5eadd51bcf54e65a1f9e83418dbc45"}
Jul 13 03:49:29.008570 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.008555    2582 scope.go:117] "RemoveContainer" containerID="497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"
Jul 13 03:49:29.008871 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:29.008853    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846\": container with ID starting with 497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846 not found: ID does not exist" containerID="497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"
Jul 13 03:49:29.008936 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.008878    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846"} err="failed to get container status \"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846\": rpc error: code = NotFound desc = could not find container \"497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846\": container with ID starting with 497e9b9d5465fd129dbb9556ac6e16eca8e15a1940d8b14ca645fae504706846 not found: ID does not exist"
Jul 13 03:49:29.008936 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.008894    2582 scope.go:117] "RemoveContainer" containerID="f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"
Jul 13 03:49:29.016368 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.016348    2582 scope.go:117] "RemoveContainer" containerID="f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"
Jul 13 03:49:29.016601 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:29.016582    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476\": container with ID starting with f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476 not found: ID does not exist" containerID="f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"
Jul 13 03:49:29.016645 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.016609    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476"} err="failed to get container status \"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476\": rpc error: code = NotFound desc = could not find container \"f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476\": container with ID starting with f69b7b26004330785d973d6cb5479df7f7287810eca07cb26d1246c7d4691476 not found: ID does not exist"
Jul 13 03:49:29.018926 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.018903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:29.022672 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.022655    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-b2jpp"]
Jul 13 03:49:29.031188 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.031168    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:49:29.033223 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.033206    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-7gmhx"]
Jul 13 03:49:29.759506 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.759472    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="192e872e-94d0-473a-8aad-3886afdf313d" path="/var/lib/kubelet/pods/192e872e-94d0-473a-8aad-3886afdf313d/volumes"
Jul 13 03:49:29.759878 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:29.759799    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" path="/var/lib/kubelet/pods/fe5bba66-fcb2-47fb-b6f3-057ec290615a/volumes"
Jul 13 03:49:32.188901 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.188861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:32.286092 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.286059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:32.361522 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.361490    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:32.365282 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365254    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:49:32.365625 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365608    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" containerName="authorino"
Jul 13 03:49:32.365699 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365628    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" containerName="authorino"
Jul 13 03:49:32.365699 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365659    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="192e872e-94d0-473a-8aad-3886afdf313d" containerName="authorino"
Jul 13 03:49:32.365699 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365668    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="192e872e-94d0-473a-8aad-3886afdf313d" containerName="authorino"
Jul 13 03:49:32.365939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365779    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe5bba66-fcb2-47fb-b6f3-057ec290615a" containerName="authorino"
Jul 13 03:49:32.365939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.365794    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="192e872e-94d0-473a-8aad-3886afdf313d" containerName="authorino"
Jul 13 03:49:32.370863 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.370843    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.373181 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.373157    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 13 03:49:32.373284 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.373252    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ckb6x\""
Jul 13 03:49:32.373588 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.373573    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 13 03:49:32.378704 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.378289    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:49:32.471943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.471853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.471943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.471907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w46fx\" (UniqueName: \"kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.572571 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.572539    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.572781 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.572589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w46fx\" (UniqueName: \"kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.572781 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:32.572696    2582 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 13 03:49:32.572874 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:49:32.572786    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert podName:b3610f45-ade3-453e-97c0-0cfca6d4452f nodeName:}" failed. No retries permitted until 2026-07-13 03:49:33.07276922 +0000 UTC m=+491.848483477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert") pod "maas-controller-59f8b857c-vg7q4" (UID: "b3610f45-ade3-453e-97c0-0cfca6d4452f") : secret "maas-controller-webhook-cert" not found
Jul 13 03:49:32.582999 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.582967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w46fx\" (UniqueName: \"kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:32.662020 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:32.661990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:33.077928 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:33.077899    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:33.080206 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:33.080177    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") pod \"maas-controller-59f8b857c-vg7q4\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") " pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:33.282962 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:33.282924    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:33.411487 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:33.411462    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:49:33.413897 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:49:33.413870    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3610f45_ade3_453e_97c0_0cfca6d4452f.slice/crio-cd7542c13ab4f216396a277aa30a4003c5887ace179eb74510afbfa0534480fa WatchSource:0}: Error finding container cd7542c13ab4f216396a277aa30a4003c5887ace179eb74510afbfa0534480fa: Status 404 returned error can't find the container with id cd7542c13ab4f216396a277aa30a4003c5887ace179eb74510afbfa0534480fa
Jul 13 03:49:34.026817 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:34.026779    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-vg7q4" event={"ID":"b3610f45-ade3-453e-97c0-0cfca6d4452f","Type":"ContainerStarted","Data":"cd7542c13ab4f216396a277aa30a4003c5887ace179eb74510afbfa0534480fa"}
Jul 13 03:49:35.247587 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:35.247559    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:35.345045 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:35.345005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:36.038058 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:36.038025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-vg7q4" event={"ID":"b3610f45-ade3-453e-97c0-0cfca6d4452f","Type":"ContainerStarted","Data":"67f1a38852bd54cc59c58f78e65fd7c29a87fd3934c83c9ae88221e7877b6714"}
Jul 13 03:49:36.038250 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:36.038089    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:49:36.055353 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:36.055301    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59f8b857c-vg7q4" podStartSLOduration=2.259692363 podStartE2EDuration="4.055286314s" totalImagesPullingTime="1.795593951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:49:36.053818918 +0000 UTC m=+494.829533197" watchObservedRunningTime="2026-07-13 03:49:36.055286314 +0000 UTC m=+494.831000598"
Jul 13 03:49:43.009207 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:43.009167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:43.109475 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:43.109431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:49:47.046807 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:49:47.046773    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:50:06.696973 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:06.696931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:07.133205 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.133169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:07.187788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.187754    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"]
Jul 13 03:50:07.213695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.213664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"]
Jul 13 03:50:07.213868 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.213738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.216261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.216238    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 13 03:50:07.216478 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.216458    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kd7hr\""
Jul 13 03:50:07.248916 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.248876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:07.367413 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.367385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-openshift-service-ca\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.367413 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.367416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-maas-api-tls\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.367643 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.367450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd22w\" (UniqueName: \"kubernetes.io/projected/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-kube-api-access-vd22w\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.468649 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.468576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd22w\" (UniqueName: \"kubernetes.io/projected/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-kube-api-access-vd22w\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.468809 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.468656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-openshift-service-ca\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.468809 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.468678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-maas-api-tls\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.469262 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.469240    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-openshift-service-ca\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.471106 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.471084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-maas-api-tls\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.479868 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.479848    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd22w\" (UniqueName: \"kubernetes.io/projected/00e1f046-8ab6-4fd5-a4ff-ca53d8612923-kube-api-access-vd22w\") pod \"maas-api-b9ccf5cf-j9md4\" (UID: \"00e1f046-8ab6-4fd5-a4ff-ca53d8612923\") " pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.520552 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.520518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:07.524413 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.524394    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:07.614469 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.614426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:07.685639 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:07.685604    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"]
Jul 13 03:50:07.688470 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:50:07.688444    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e1f046_8ab6_4fd5_a4ff_ca53d8612923.slice/crio-1d2f2282917059d8f947ff452be9b38c2376282972e703f89bac4d11da56947a WatchSource:0}: Error finding container 1d2f2282917059d8f947ff452be9b38c2376282972e703f89bac4d11da56947a: Status 404 returned error can't find the container with id 1d2f2282917059d8f947ff452be9b38c2376282972e703f89bac4d11da56947a
Jul 13 03:50:08.179201 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:08.179163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4" event={"ID":"00e1f046-8ab6-4fd5-a4ff-ca53d8612923","Type":"ContainerStarted","Data":"1d2f2282917059d8f947ff452be9b38c2376282972e703f89bac4d11da56947a"}
Jul 13 03:50:10.190225 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:10.190186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4" event={"ID":"00e1f046-8ab6-4fd5-a4ff-ca53d8612923","Type":"ContainerStarted","Data":"8fa7cb8af4529f870412529a13e13649cf63c9cc7cdfdf8381ad522176330798"}
Jul 13 03:50:10.190600 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:10.190296    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:10.206432 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:10.206387    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4" podStartSLOduration=1.513463328 podStartE2EDuration="3.206371241s" totalImagesPullingTime="1.692907913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:50:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:50:10.205281064 +0000 UTC m=+528.980995344" watchObservedRunningTime="2026-07-13 03:50:10.206371241 +0000 UTC m=+528.982085519"
Jul 13 03:50:15.214416 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.214332    2582 generic.go:356] "Generic (PLEG): container finished" podID="4ea189d5-50d2-4844-adc7-c6603860bd8f" containerID="4b139e9c924e044e4fe0a998a54ea177e852eba8ae11119b22633301b464f1e1" exitCode=0
Jul 13 03:50:15.214416 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.214385    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" event={"ID":"4ea189d5-50d2-4844-adc7-c6603860bd8f","Type":"ContainerDied","Data":"4b139e9c924e044e4fe0a998a54ea177e852eba8ae11119b22633301b464f1e1"}
Jul 13 03:50:15.214876 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.214794    2582 scope.go:117] "RemoveContainer" containerID="4b139e9c924e044e4fe0a998a54ea177e852eba8ae11119b22633301b464f1e1"
Jul 13 03:50:15.215843 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.215813    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:50:15.215920 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.215885    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:50:15.215961 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:15.215919    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 03:50:16.200715 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:16.200686    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-b9ccf5cf-j9md4"
Jul 13 03:50:16.220402 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:16.220373    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" event={"ID":"4ea189d5-50d2-4844-adc7-c6603860bd8f","Type":"ContainerStarted","Data":"bbea2136b5bab6d8ffbd0f11c9cbe482948d09c24985d8ecfae116b865155ca1"}
Jul 13 03:50:16.767261 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:16.767221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:50:16.767440 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:16.767397    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7wqp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 13 03:50:16.767485 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:16.767442    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" podUID="4ea189d5-50d2-4844-adc7-c6603860bd8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 13 03:50:17.178976 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:17.178931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:17.278784 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:17.278754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:17.767840 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:17.767806    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7wqp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 13 03:50:17.768011 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:17.767868    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" podUID="4ea189d5-50d2-4844-adc7-c6603860bd8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 13 03:50:18.768301 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:18.768264    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7wqp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 13 03:50:18.768670 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:18.768336    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" podUID="4ea189d5-50d2-4844-adc7-c6603860bd8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 13 03:50:19.768107 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:19.768072    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-7wqp5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 13 03:50:19.768289 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:19.768135    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5" podUID="4ea189d5-50d2-4844-adc7-c6603860bd8f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 13 03:50:20.771796 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:20.771765    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:50:20.772259 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:20.772171    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:50:20.772956 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:20.772936    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-7wqp5"
Jul 13 03:50:55.088365 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.088324    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"]
Jul 13 03:50:55.092436 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.092412    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.094967 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.094948    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 13 03:50:55.095088 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.095021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 13 03:50:55.095858 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.095823    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 13 03:50:55.095858 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.095840    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w2wk8\""
Jul 13 03:50:55.099106 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.099083    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"]
Jul 13 03:50:55.116061 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.116028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:50:55.165290 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.165438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165307    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.165438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165330    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4bwg\" (UniqueName: \"kubernetes.io/projected/a7cd2620-b7f3-4383-baec-02f886d9ab28-kube-api-access-f4bwg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.165438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.165438 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165371    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cd2620-b7f3-4383-baec-02f886d9ab28-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.165567 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.165463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.265925 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.265887    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266102 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.265935    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266102 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.265952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4bwg\" (UniqueName: \"kubernetes.io/projected/a7cd2620-b7f3-4383-baec-02f886d9ab28-kube-api-access-f4bwg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266102 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.265974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266102 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.265988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cd2620-b7f3-4383-baec-02f886d9ab28-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266102 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.266032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266352 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.266332    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266425 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.266403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.266490 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.266475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.268217 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.268195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7cd2620-b7f3-4383-baec-02f886d9ab28-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.268475 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.268456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7cd2620-b7f3-4383-baec-02f886d9ab28-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.272987 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.272965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4bwg\" (UniqueName: \"kubernetes.io/projected/a7cd2620-b7f3-4383-baec-02f886d9ab28-kube-api-access-f4bwg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l\" (UID: \"a7cd2620-b7f3-4383-baec-02f886d9ab28\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.405243 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.405129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:50:55.537641 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:55.537618    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"]
Jul 13 03:50:55.539971 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:50:55.539937    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7cd2620_b7f3_4383_baec_02f886d9ab28.slice/crio-e2a48053060309919b3a9f18d26e5297385e58f30305ebd139ce0569513e7637 WatchSource:0}: Error finding container e2a48053060309919b3a9f18d26e5297385e58f30305ebd139ce0569513e7637: Status 404 returned error can't find the container with id e2a48053060309919b3a9f18d26e5297385e58f30305ebd139ce0569513e7637
Jul 13 03:50:56.417420 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:56.417384    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l" event={"ID":"a7cd2620-b7f3-4383-baec-02f886d9ab28","Type":"ContainerStarted","Data":"e2a48053060309919b3a9f18d26e5297385e58f30305ebd139ce0569513e7637"}
Jul 13 03:50:57.424391 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:57.424356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l" event={"ID":"a7cd2620-b7f3-4383-baec-02f886d9ab28","Type":"ContainerStarted","Data":"90316083c0043508e97a2e85950495981d4814ae78c1f7a7c74bbb3342a10d67"}
Jul 13 03:50:57.442523 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:50:57.442473    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l" podStartSLOduration=1.137538079 podStartE2EDuration="2.442456979s" totalImagesPullingTime="1.3049189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:50:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:50:57.441258363 +0000 UTC m=+576.216972643" watchObservedRunningTime="2026-07-13 03:50:57.442456979 +0000 UTC m=+576.218171258"
Jul 13 03:51:00.874050 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:00.874022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:51:00.933333 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:00.933298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:51:05.406625 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:05.406586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:51:05.407040 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:05.406644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:51:05.418606 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:05.418580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:51:05.473154 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:05.473129    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l"
Jul 13 03:51:12.274617 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:12.274543    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:51:20.165940 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.165907    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"]
Jul 13 03:51:20.169486 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.169469    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.172115 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.172093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 13 03:51:20.177788 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.177673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"]
Jul 13 03:51:20.192116 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.192085    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:51:20.195743 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.195848 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.195848 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zblkh\" (UniqueName: \"kubernetes.io/projected/0335cf1a-5a63-4554-a0e1-ec289c238db3-kube-api-access-zblkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.195935 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0335cf1a-5a63-4554-a0e1-ec289c238db3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.195935 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.195935 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.195924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296366 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296546 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296546 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zblkh\" (UniqueName: \"kubernetes.io/projected/0335cf1a-5a63-4554-a0e1-ec289c238db3-kube-api-access-zblkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296546 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296435    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0335cf1a-5a63-4554-a0e1-ec289c238db3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296546 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296546 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296918 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.296975 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296934    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.297034 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.296986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.298686 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.298664    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0335cf1a-5a63-4554-a0e1-ec289c238db3-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.299486 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.299468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0335cf1a-5a63-4554-a0e1-ec289c238db3-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.303894 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.303873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zblkh\" (UniqueName: \"kubernetes.io/projected/0335cf1a-5a63-4554-a0e1-ec289c238db3-kube-api-access-zblkh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6\" (UID: \"0335cf1a-5a63-4554-a0e1-ec289c238db3\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.481703 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.481614    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:20.613003 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:20.612981    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"]
Jul 13 03:51:20.615252 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:51:20.615225    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0335cf1a_5a63_4554_a0e1_ec289c238db3.slice/crio-3d04f435db64c278029a27aedba5cd646f229fb73ee5f21336531da3497ba4c9 WatchSource:0}: Error finding container 3d04f435db64c278029a27aedba5cd646f229fb73ee5f21336531da3497ba4c9: Status 404 returned error can't find the container with id 3d04f435db64c278029a27aedba5cd646f229fb73ee5f21336531da3497ba4c9
Jul 13 03:51:21.539073 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:21.539040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6" event={"ID":"0335cf1a-5a63-4554-a0e1-ec289c238db3","Type":"ContainerStarted","Data":"9009c53ea8c660e710cc6c681d804e48ec61e7d628ad41729daedf64ab165870"}
Jul 13 03:51:21.539475 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:21.539092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6" event={"ID":"0335cf1a-5a63-4554-a0e1-ec289c238db3","Type":"ContainerStarted","Data":"3d04f435db64c278029a27aedba5cd646f229fb73ee5f21336531da3497ba4c9"}
Jul 13 03:51:21.559271 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:21.559216    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6" podStartSLOduration=1.352604589 podStartE2EDuration="1.559197175s" totalImagesPullingTime="206.592586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:51:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:51:21.557673227 +0000 UTC m=+600.333387507" watchObservedRunningTime="2026-07-13 03:51:21.559197175 +0000 UTC m=+600.334911453"
Jul 13 03:51:21.693276 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:21.693244    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:51:21.694838 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:21.694818    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:51:30.482294 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:30.482253    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:30.482939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:30.482335    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:30.495295 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:30.495270    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:30.592062 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:30.592036    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6"
Jul 13 03:51:34.908754 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:34.908705    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:51:44.681993 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:51:44.681914    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:33.617457 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:33.617425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:35.114993 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.114959    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-55dd78bb6f-lnr5z"]
Jul 13 03:52:35.118275 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.118251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.124633 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.124610    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55dd78bb6f-lnr5z"]
Jul 13 03:52:35.249086 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.249052    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dxz\" (UniqueName: \"kubernetes.io/projected/97b5e447-c450-4928-b518-692f8723f059-kube-api-access-j8dxz\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.249236 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.249094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97b5e447-c450-4928-b518-692f8723f059-tls-cert\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.350621 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.350588    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dxz\" (UniqueName: \"kubernetes.io/projected/97b5e447-c450-4928-b518-692f8723f059-kube-api-access-j8dxz\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.350938 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.350908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97b5e447-c450-4928-b518-692f8723f059-tls-cert\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.353491 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.353470    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97b5e447-c450-4928-b518-692f8723f059-tls-cert\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.359178 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.359152    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dxz\" (UniqueName: \"kubernetes.io/projected/97b5e447-c450-4928-b518-692f8723f059-kube-api-access-j8dxz\") pod \"authorino-55dd78bb6f-lnr5z\" (UID: \"97b5e447-c450-4928-b518-692f8723f059\") " pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.403656 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.403573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:35.428701 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.428682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-55dd78bb6f-lnr5z"
Jul 13 03:52:35.502027 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.501992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:35.554603 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.554578    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-55dd78bb6f-lnr5z"]
Jul 13 03:52:35.556835 ip-10-0-141-187 kubenswrapper[2582]: W0713 03:52:35.556812    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97b5e447_c450_4928_b518_692f8723f059.slice/crio-077b2a39e8fea0de24c9ce1697c491640218cdc59995cc19b22bfbbdc696e14d WatchSource:0}: Error finding container 077b2a39e8fea0de24c9ce1697c491640218cdc59995cc19b22bfbbdc696e14d: Status 404 returned error can't find the container with id 077b2a39e8fea0de24c9ce1697c491640218cdc59995cc19b22bfbbdc696e14d
Jul 13 03:52:35.558405 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.558390    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 03:52:35.884076 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:35.884036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55dd78bb6f-lnr5z" event={"ID":"97b5e447-c450-4928-b518-692f8723f059","Type":"ContainerStarted","Data":"077b2a39e8fea0de24c9ce1697c491640218cdc59995cc19b22bfbbdc696e14d"}
Jul 13 03:52:36.514395 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.514358    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:36.615856 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.615818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:52:36.892669 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.892629    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-55dd78bb6f-lnr5z" event={"ID":"97b5e447-c450-4928-b518-692f8723f059","Type":"ContainerStarted","Data":"c8c73ad36561f4588749e2b649ca65ca20f38b0235ef25edac60afe37e19a997"}
Jul 13 03:52:36.913522 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.913464    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-55dd78bb6f-lnr5z" podStartSLOduration=1.497067019 podStartE2EDuration="1.913442717s" totalImagesPullingTime="416.375698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 03:52:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 03:52:36.912061381 +0000 UTC m=+675.687775660" watchObservedRunningTime="2026-07-13 03:52:36.913442717 +0000 UTC m=+675.689156997"
Jul 13 03:52:36.952273 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.951684    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:52:36.952273 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:36.951897    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" podUID="70a025cb-b570-4972-8479-494beeb69722" containerName="authorino" containerID="cri-o://ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df" gracePeriod=30
Jul 13 03:52:37.210757 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.210703    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:52:37.368008 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.367968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert\") pod \"70a025cb-b570-4972-8479-494beeb69722\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") "
Jul 13 03:52:37.368201 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.368044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd4s9\" (UniqueName: \"kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9\") pod \"70a025cb-b570-4972-8479-494beeb69722\" (UID: \"70a025cb-b570-4972-8479-494beeb69722\") "
Jul 13 03:52:37.370022 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.369989    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9" (OuterVolumeSpecName: "kube-api-access-gd4s9") pod "70a025cb-b570-4972-8479-494beeb69722" (UID: "70a025cb-b570-4972-8479-494beeb69722"). InnerVolumeSpecName "kube-api-access-gd4s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:52:37.379993 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.379957    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "70a025cb-b570-4972-8479-494beeb69722" (UID: "70a025cb-b570-4972-8479-494beeb69722"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:52:37.469162 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.469057    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd4s9\" (UniqueName: \"kubernetes.io/projected/70a025cb-b570-4972-8479-494beeb69722-kube-api-access-gd4s9\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:52:37.469162 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.469090    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/70a025cb-b570-4972-8479-494beeb69722-tls-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:52:37.898836 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.898795    2582 generic.go:356] "Generic (PLEG): container finished" podID="70a025cb-b570-4972-8479-494beeb69722" containerID="ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df" exitCode=0
Jul 13 03:52:37.899287 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.898844    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f558dfdfb-f8r27"
Jul 13 03:52:37.899287 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.898850    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" event={"ID":"70a025cb-b570-4972-8479-494beeb69722","Type":"ContainerDied","Data":"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"}
Jul 13 03:52:37.899287 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.898900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f558dfdfb-f8r27" event={"ID":"70a025cb-b570-4972-8479-494beeb69722","Type":"ContainerDied","Data":"d64e68dcde4459dee90016ac000f3058ee3be7920172e530ee0e6c04cd6a119d"}
Jul 13 03:52:37.899287 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.898925    2582 scope.go:117] "RemoveContainer" containerID="ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"
Jul 13 03:52:37.907662 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.907646    2582 scope.go:117] "RemoveContainer" containerID="ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"
Jul 13 03:52:37.907951 ip-10-0-141-187 kubenswrapper[2582]: E0713 03:52:37.907931    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df\": container with ID starting with ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df not found: ID does not exist" containerID="ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"
Jul 13 03:52:37.908035 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.907957    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df"} err="failed to get container status \"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df\": rpc error: code = NotFound desc = could not find container \"ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df\": container with ID starting with ffd84081d34c7e784072e0d1453c117d8ab96cc57f6b02b2acd99b58f6a377df not found: ID does not exist"
Jul 13 03:52:37.914109 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.914082    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:52:37.918062 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:37.918039    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f558dfdfb-f8r27"]
Jul 13 03:52:39.759804 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:52:39.759771    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70a025cb-b570-4972-8479-494beeb69722" path="/var/lib/kubelet/pods/70a025cb-b570-4972-8479-494beeb69722/volumes"
Jul 13 03:53:45.979312 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:45.979274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:53:46.084624 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.084584    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:53:46.084939 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.084907    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-59f8b857c-vg7q4" podUID="b3610f45-ade3-453e-97c0-0cfca6d4452f" containerName="manager" containerID="cri-o://67f1a38852bd54cc59c58f78e65fd7c29a87fd3934c83c9ae88221e7877b6714" gracePeriod=30
Jul 13 03:53:46.229869 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.229784    2582 generic.go:356] "Generic (PLEG): container finished" podID="b3610f45-ade3-453e-97c0-0cfca6d4452f" containerID="67f1a38852bd54cc59c58f78e65fd7c29a87fd3934c83c9ae88221e7877b6714" exitCode=0
Jul 13 03:53:46.229869 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.229848    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-vg7q4" event={"ID":"b3610f45-ade3-453e-97c0-0cfca6d4452f","Type":"ContainerDied","Data":"67f1a38852bd54cc59c58f78e65fd7c29a87fd3934c83c9ae88221e7877b6714"}
Jul 13 03:53:46.333524 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.333499    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:53:46.394185 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.394096    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") pod \"b3610f45-ade3-453e-97c0-0cfca6d4452f\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") "
Jul 13 03:53:46.394335 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.394222    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w46fx\" (UniqueName: \"kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx\") pod \"b3610f45-ade3-453e-97c0-0cfca6d4452f\" (UID: \"b3610f45-ade3-453e-97c0-0cfca6d4452f\") "
Jul 13 03:53:46.396158 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.396122    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b3610f45-ade3-453e-97c0-0cfca6d4452f" (UID: "b3610f45-ade3-453e-97c0-0cfca6d4452f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 03:53:46.396291 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.396220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx" (OuterVolumeSpecName: "kube-api-access-w46fx") pod "b3610f45-ade3-453e-97c0-0cfca6d4452f" (UID: "b3610f45-ade3-453e-97c0-0cfca6d4452f"). InnerVolumeSpecName "kube-api-access-w46fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 03:53:46.495827 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.495753    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3610f45-ade3-453e-97c0-0cfca6d4452f-webhook-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:53:46.495827 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:46.495779    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w46fx\" (UniqueName: \"kubernetes.io/projected/b3610f45-ade3-453e-97c0-0cfca6d4452f-kube-api-access-w46fx\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 03:53:47.240943 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.240915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59f8b857c-vg7q4"
Jul 13 03:53:47.241359 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.240909    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59f8b857c-vg7q4" event={"ID":"b3610f45-ade3-453e-97c0-0cfca6d4452f","Type":"ContainerDied","Data":"cd7542c13ab4f216396a277aa30a4003c5887ace179eb74510afbfa0534480fa"}
Jul 13 03:53:47.241359 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.241078    2582 scope.go:117] "RemoveContainer" containerID="67f1a38852bd54cc59c58f78e65fd7c29a87fd3934c83c9ae88221e7877b6714"
Jul 13 03:53:47.261588 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.261565    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:53:47.264449 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.264430    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59f8b857c-vg7q4"]
Jul 13 03:53:47.761010 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.760977    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3610f45-ade3-453e-97c0-0cfca6d4452f" path="/var/lib/kubelet/pods/b3610f45-ade3-453e-97c0-0cfca6d4452f/volumes"
Jul 13 03:53:47.899118 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:53:47.899082    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:24.091025 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:24.090991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:24.187949 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:24.187916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:24.299890 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:24.299854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:27.228605 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:27.228570    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:27.329970 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:27.329934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:29.958511 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:29.958476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:30.017661 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:30.017634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:30.093385 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:30.093354    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:30.194773 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:30.194716    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:30.295748 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:30.295647    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:35.780969 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:35.780931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:54:35.841300 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:54:35.841267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:55:16.042695 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:55:16.042657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:55:16.142905 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:55:16.142866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:55:28.995854 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:55:28.995818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:56:21.724365 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:56:21.724290    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:56:21.724365 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:56:21.724295    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 03:57:29.150281 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:57:29.150241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 03:58:40.818759 ip-10-0-141-187 kubenswrapper[2582]: I0713 03:58:40.818692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:01:21.749773 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:01:21.749665    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:01:21.752017 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:01:21.751998    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:02:19.694635 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:02:19.694552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:15.834919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:15.834840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:23.179262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:23.179213    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:31.425034 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:31.424992    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:36.507151 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:36.507112    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:39.243321 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:39.243277    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:39.343826 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:39.343789    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:39.675502 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:39.675473    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:45.257352 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.257311    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:45.316407 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.316370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:45.416934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.416895    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:45.417324 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417308    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3610f45-ade3-453e-97c0-0cfca6d4452f" containerName="manager"
Jul 13 04:05:45.417324 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417323    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3610f45-ade3-453e-97c0-0cfca6d4452f" containerName="manager"
Jul 13 04:05:45.417449 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417334    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70a025cb-b570-4972-8479-494beeb69722" containerName="authorino"
Jul 13 04:05:45.417449 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417339    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="70a025cb-b570-4972-8479-494beeb69722" containerName="authorino"
Jul 13 04:05:45.417449 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417397    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="70a025cb-b570-4972-8479-494beeb69722" containerName="authorino"
Jul 13 04:05:45.417449 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.417407    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3610f45-ade3-453e-97c0-0cfca6d4452f" containerName="manager"
Jul 13 04:05:45.420354 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.420335    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.422829 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.422807    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-343d5741-openshift-default-dockercfg-2467s\""
Jul 13 04:05:45.438356 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.438331    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:45.572179 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572371 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572371 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572371 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572371 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572584 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572584 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572584 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.572584 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.572555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhv9j\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673038 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.672999    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673038 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673041    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhv9j\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673602 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673308    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673602 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673447    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673602 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673791 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673639    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673791 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.673890 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.673869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.675628 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.675606    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.675860 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.675841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.683072 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.683051    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.683263 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.683241    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhv9j\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j\") pod \"e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") " pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.732010 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.731972    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:45.872045 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.871971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:45.874878 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:05:45.874847    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8329cc_f083_415b_8616_a97da14b87af.slice/crio-c4f20ce67650793a7c387db12881e7f667afbd26ec029179390519d4703ad7b6 WatchSource:0}: Error finding container c4f20ce67650793a7c387db12881e7f667afbd26ec029179390519d4703ad7b6: Status 404 returned error can't find the container with id c4f20ce67650793a7c387db12881e7f667afbd26ec029179390519d4703ad7b6
Jul 13 04:05:45.876956 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.876920    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:45.877035 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.876989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:45.877035 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:45.877022    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:46.358853 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.358812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:46.458675 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.458640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:46.533477 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.533439    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" event={"ID":"2a8329cc-f083-415b-8616-a97da14b87af","Type":"ContainerStarted","Data":"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"}
Jul 13 04:05:46.533642 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.533509    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" event={"ID":"2a8329cc-f083-415b-8616-a97da14b87af","Type":"ContainerStarted","Data":"c4f20ce67650793a7c387db12881e7f667afbd26ec029179390519d4703ad7b6"}
Jul 13 04:05:46.561601 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.561541    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" podStartSLOduration=1.5615175369999998 podStartE2EDuration="1.561517537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:05:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:05:46.558214842 +0000 UTC m=+1465.333929121" watchObservedRunningTime="2026-07-13 04:05:46.561517537 +0000 UTC m=+1465.337231821"
Jul 13 04:05:46.561849 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.561637    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:46.625207 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.625120    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:46.630780 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.629399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.632653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.632633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-343d5741-serving-cert\""
Jul 13 04:05:46.645517 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.641320    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:46.657189 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.657140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:46.732229 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.732183    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:46.734144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.734113    2582 patch_prober.go:28] interesting pod/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 13 04:05:46.734286 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.734190    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" podUID="2a8329cc-f083-415b-8616-a97da14b87af" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 13 04:05:46.784747 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.784689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wv8d\" (UniqueName: \"kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.784747 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.784741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.784995 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.784881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.813037 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.813007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:46.886547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.886442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wv8d\" (UniqueName: \"kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.886547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.886501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.886828 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.886591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.886828 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:46.886674    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-serving-cert: secret "maas-api-e2e-ait-343d5741-serving-cert" not found
Jul 13 04:05:46.886828 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:46.886763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls podName:71b3a478-a86d-4fee-9ed4-7091aaa24f94 nodeName:}" failed. No retries permitted until 2026-07-13 04:05:47.386724225 +0000 UTC m=+1466.162438486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls") pod "maas-api-e2e-ait-343d5741-564df94d75-vq7zt" (UID: "71b3a478-a86d-4fee-9ed4-7091aaa24f94") : secret "maas-api-e2e-ait-343d5741-serving-cert" not found
Jul 13 04:05:46.887352 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.887333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:46.898781 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:46.898748    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wv8d\" (UniqueName: \"kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:47.032835 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.032798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:47.250033 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.249942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:47.348970 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.348935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:47.390966 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.390927    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:47.393622 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.393596    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") pod \"maas-api-e2e-ait-343d5741-564df94d75-vq7zt\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:47.549640 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.549555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:47.688631 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.688608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:47.691156 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:05:47.691130    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b3a478_a86d_4fee_9ed4_7091aaa24f94.slice/crio-a02433990b4447330e42eb883e1a24082df94af453f7cc562c851b1a0007ec3b WatchSource:0}: Error finding container a02433990b4447330e42eb883e1a24082df94af453f7cc562c851b1a0007ec3b: Status 404 returned error can't find the container with id a02433990b4447330e42eb883e1a24082df94af453f7cc562c851b1a0007ec3b
Jul 13 04:05:47.692623 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.692604    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 04:05:47.736167 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:47.736137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:48.546334 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.546286    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" event={"ID":"71b3a478-a86d-4fee-9ed4-7091aaa24f94","Type":"ContainerStarted","Data":"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"}
Jul 13 04:05:48.546709 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.546353    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" event={"ID":"71b3a478-a86d-4fee-9ed4-7091aaa24f94","Type":"ContainerStarted","Data":"a02433990b4447330e42eb883e1a24082df94af453f7cc562c851b1a0007ec3b"}
Jul 13 04:05:48.546709 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.546606    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:48.546709 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.546665    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:48.547594 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.547572    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:48.563983 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:48.563785    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" podStartSLOduration=1.843776077 podStartE2EDuration="2.563765644s" totalImagesPullingTime="719.989567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:05:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:05:48.561396199 +0000 UTC m=+1467.337110479" watchObservedRunningTime="2026-07-13 04:05:48.563765644 +0000 UTC m=+1467.339479926"
Jul 13 04:05:49.024306 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:49.024254    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:51.603930 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.603900    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:51.764191 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.764151    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:51.764391 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.764344    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" podUID="2a8329cc-f083-415b-8616-a97da14b87af" containerName="istio-proxy" containerID="cri-o://75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069" gracePeriod=30
Jul 13 04:05:51.787295 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.787266    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:51.887941 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.887852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:51.911855 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.911813    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:51.912089 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.912058    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" podUID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" containerName="maas-api" containerID="cri-o://66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8" gracePeriod=30
Jul 13 04:05:51.949754 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:51.947623    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:52.209958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.209929    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:52.255348 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.255311    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wv8d\" (UniqueName: \"kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d\") pod \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") "
Jul 13 04:05:52.255538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.255390    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca\") pod \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") "
Jul 13 04:05:52.255538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.255489    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") pod \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\" (UID: \"71b3a478-a86d-4fee-9ed4-7091aaa24f94\") "
Jul 13 04:05:52.256043 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.256014    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71b3a478-a86d-4fee-9ed4-7091aaa24f94" (UID: "71b3a478-a86d-4fee-9ed4-7091aaa24f94"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:05:52.257916 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.257880    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71b3a478-a86d-4fee-9ed4-7091aaa24f94" (UID: "71b3a478-a86d-4fee-9ed4-7091aaa24f94"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:05:52.258020 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.257961    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d" (OuterVolumeSpecName: "kube-api-access-6wv8d") pod "71b3a478-a86d-4fee-9ed4-7091aaa24f94" (UID: "71b3a478-a86d-4fee-9ed4-7091aaa24f94"). InnerVolumeSpecName "kube-api-access-6wv8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:05:52.356458 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.356415    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71b3a478-a86d-4fee-9ed4-7091aaa24f94-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:52.356458 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.356453    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wv8d\" (UniqueName: \"kubernetes.io/projected/71b3a478-a86d-4fee-9ed4-7091aaa24f94-kube-api-access-6wv8d\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:52.356458 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.356463    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71b3a478-a86d-4fee-9ed4-7091aaa24f94-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:52.569291 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.569257    2582 generic.go:356] "Generic (PLEG): container finished" podID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" containerID="66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8" exitCode=0
Jul 13 04:05:52.569291 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.569297    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"
Jul 13 04:05:52.569549 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.569335    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" event={"ID":"71b3a478-a86d-4fee-9ed4-7091aaa24f94","Type":"ContainerDied","Data":"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"}
Jul 13 04:05:52.569549 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.569420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt" event={"ID":"71b3a478-a86d-4fee-9ed4-7091aaa24f94","Type":"ContainerDied","Data":"a02433990b4447330e42eb883e1a24082df94af453f7cc562c851b1a0007ec3b"}
Jul 13 04:05:52.569549 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.569443    2582 scope.go:117] "RemoveContainer" containerID="66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"
Jul 13 04:05:52.579124 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.579101    2582 scope.go:117] "RemoveContainer" containerID="66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"
Jul 13 04:05:52.579441 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:52.579420    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8\": container with ID starting with 66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8 not found: ID does not exist" containerID="66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"
Jul 13 04:05:52.579494 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.579451    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8"} err="failed to get container status \"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8\": rpc error: code = NotFound desc = could not find container \"66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8\": container with ID starting with 66276206ab4f912808cf5c0cf42e42fe5329f8ccc7d1a73b40df8b55ba56bcc8 not found: ID does not exist"
Jul 13 04:05:52.590876 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.590845    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:52.594599 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:52.594565    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-343d5741-564df94d75-vq7zt"]
Jul 13 04:05:53.569688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:53.569650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:53.761146 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:53.761107    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" path="/var/lib/kubelet/pods/71b3a478-a86d-4fee-9ed4-7091aaa24f94/volumes"
Jul 13 04:05:57.584671 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.584633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:57.685330 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.685297    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:57.762921 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.762879    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:05:57.763993 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.763966    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" containerName="maas-api"
Jul 13 04:05:57.764190 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.764177    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" containerName="maas-api"
Jul 13 04:05:57.764532 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.764518    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="71b3a478-a86d-4fee-9ed4-7091aaa24f94" containerName="maas-api"
Jul 13 04:05:57.771794 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.771760    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.773212 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.771846    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:05:57.775605 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.775579    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d88d530b-openshift-default-dockercfg-5brrm\""
Jul 13 04:05:57.788669 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.788640    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:57.814848 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.814811    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.814848 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.814853    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.814949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8ddj\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.814981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.815017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.815132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.815159    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.815184    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.815275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.815209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.889615 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.889580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:57.915942 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.915906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.915942 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.915945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.915967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.915991    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916078    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8ddj\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916521 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916372    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916521 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916406    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916668 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916644    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916792 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916891 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.916956 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.916928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.918441 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.918417    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.918767 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.918747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.925655 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.925621    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:57.925881 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:57.925766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8ddj\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj\") pod \"e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") " pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:58.085319 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.085276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:58.130206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.129857    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:58.219487 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219455    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219510    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219539    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219584    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhv9j\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.219710 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219711    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.220154 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219791    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket\") pod \"2a8329cc-f083-415b-8616-a97da14b87af\" (UID: \"2a8329cc-f083-415b-8616-a97da14b87af\") "
Jul 13 04:05:58.220154 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219950    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:05:58.220347 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.220161    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:05:58.220347 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.219917    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:05:58.220347 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.220183    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2a8329cc-f083-415b-8616-a97da14b87af-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.220347 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.220180    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:05:58.221255 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.220711    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data" (OuterVolumeSpecName: "istio-data") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:05:58.222141 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.222109    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j" (OuterVolumeSpecName: "kube-api-access-nhv9j") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "kube-api-access-nhv9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:05:58.222250 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.222152    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:05:58.222308 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.222267    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token" (OuterVolumeSpecName: "istio-token") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:05:58.222362 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.222345    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2a8329cc-f083-415b-8616-a97da14b87af" (UID: "2a8329cc-f083-415b-8616-a97da14b87af"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:05:58.237894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.237858    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:05:58.239886 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:05:58.239855    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ce48572_e277_4d67_addb_59d1d6d6e047.slice/crio-88ae892459de78b6493ac5a18b59d98cac22eaee2c82ef349a6ae77318b364fe WatchSource:0}: Error finding container 88ae892459de78b6493ac5a18b59d98cac22eaee2c82ef349a6ae77318b364fe: Status 404 returned error can't find the container with id 88ae892459de78b6493ac5a18b59d98cac22eaee2c82ef349a6ae77318b364fe
Jul 13 04:05:58.241986 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.241949    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:58.242074 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.242019    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:58.242074 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.242047    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:05:58.321056 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321024    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321056 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321050    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321056 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321063    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhv9j\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-kube-api-access-nhv9j\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321073    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2a8329cc-f083-415b-8616-a97da14b87af-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321083    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321091    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321099    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2a8329cc-f083-415b-8616-a97da14b87af-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.321467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.321109    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2a8329cc-f083-415b-8616-a97da14b87af-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:05:58.604106 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.604068    2582 generic.go:356] "Generic (PLEG): container finished" podID="2a8329cc-f083-415b-8616-a97da14b87af" containerID="75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069" exitCode=0
Jul 13 04:05:58.604614 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.604112    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"
Jul 13 04:05:58.604614 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.604145    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" event={"ID":"2a8329cc-f083-415b-8616-a97da14b87af","Type":"ContainerDied","Data":"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"}
Jul 13 04:05:58.604614 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.604197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll" event={"ID":"2a8329cc-f083-415b-8616-a97da14b87af","Type":"ContainerDied","Data":"c4f20ce67650793a7c387db12881e7f667afbd26ec029179390519d4703ad7b6"}
Jul 13 04:05:58.604614 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.604224    2582 scope.go:117] "RemoveContainer" containerID="75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"
Jul 13 04:05:58.606035 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.605995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerStarted","Data":"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"}
Jul 13 04:05:58.606166 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.606050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerStarted","Data":"88ae892459de78b6493ac5a18b59d98cac22eaee2c82ef349a6ae77318b364fe"}
Jul 13 04:05:58.614381 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.614359    2582 scope.go:117] "RemoveContainer" containerID="75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"
Jul 13 04:05:58.614693 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:58.614674    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069\": container with ID starting with 75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069 not found: ID does not exist" containerID="75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"
Jul 13 04:05:58.614807 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.614710    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069"} err="failed to get container status \"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069\": rpc error: code = NotFound desc = could not find container \"75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069\": container with ID starting with 75bebda9093985e343d65650b6ce9a74979857af4a52a1a8af238deef677f069 not found: ID does not exist"
Jul 13 04:05:58.626858 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.626796    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" podStartSLOduration=1.62677169 podStartE2EDuration="1.62677169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:05:58.6246261 +0000 UTC m=+1477.400340392" watchObservedRunningTime="2026-07-13 04:05:58.62677169 +0000 UTC m=+1477.402485970"
Jul 13 04:05:58.638386 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.638348    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:58.641029 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.641000    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-343d5741-openshift-default-55c5b4c849-k27ll"]
Jul 13 04:05:58.958904 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:58.958865    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.058807 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.058773    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.085881 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.085842    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:59.091345 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.091318    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:59.110626 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.110596    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:05:59.111023 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.111008    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8329cc-f083-415b-8616-a97da14b87af" containerName="istio-proxy"
Jul 13 04:05:59.111082 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.111024    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8329cc-f083-415b-8616-a97da14b87af" containerName="istio-proxy"
Jul 13 04:05:59.111123 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.111091    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8329cc-f083-415b-8616-a97da14b87af" containerName="istio-proxy"
Jul 13 04:05:59.113899 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.113882    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.116283 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.116262    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d88d530b-serving-cert\""
Jul 13 04:05:59.124305 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.124277    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:05:59.196781 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.196666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.229151 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.229110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.229151 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.229158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.229373 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.229192    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwbh\" (UniqueName: \"kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.330770 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.330702    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.330974 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.330795    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.330974 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.330846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwbh\" (UniqueName: \"kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.330974 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:59.330862    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-serving-cert: secret "maas-api-e2e-ait-d88d530b-serving-cert" not found
Jul 13 04:05:59.330974 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:05:59.330941    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls podName:477001e0-bceb-4238-b875-6a55c8ed3a60 nodeName:}" failed. No retries permitted until 2026-07-13 04:05:59.83091922 +0000 UTC m=+1478.606633492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls") pod "maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" (UID: "477001e0-bceb-4238-b875-6a55c8ed3a60") : secret "maas-api-e2e-ait-d88d530b-serving-cert" not found
Jul 13 04:05:59.331493 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.331472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.341750 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.341708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwbh\" (UniqueName: \"kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.598360 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.598324    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.612686 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.612653    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:59.613720 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.613698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:05:59.726474 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.726428    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.761369 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.761323    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8329cc-f083-415b-8616-a97da14b87af" path="/var/lib/kubelet/pods/2a8329cc-f083-415b-8616-a97da14b87af/volumes"
Jul 13 04:05:59.827479 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.827434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:05:59.836666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.836624    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:05:59.839268 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:05:59.839236    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") pod \"maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:06:00.026000 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.025894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:06:00.192766 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.192739    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:06:00.195430 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:06:00.195399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477001e0_bceb_4238_b875_6a55c8ed3a60.slice/crio-4a7ecab9b69e8cfa6561aa867d866d7518ea577000b954e72f607d3f5158f71a WatchSource:0}: Error finding container 4a7ecab9b69e8cfa6561aa867d866d7518ea577000b954e72f607d3f5158f71a: Status 404 returned error can't find the container with id 4a7ecab9b69e8cfa6561aa867d866d7518ea577000b954e72f607d3f5158f71a
Jul 13 04:06:00.619342 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.619299    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" event={"ID":"477001e0-bceb-4238-b875-6a55c8ed3a60","Type":"ContainerStarted","Data":"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"}
Jul 13 04:06:00.619874 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.619360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" event={"ID":"477001e0-bceb-4238-b875-6a55c8ed3a60","Type":"ContainerStarted","Data":"4a7ecab9b69e8cfa6561aa867d866d7518ea577000b954e72f607d3f5158f71a"}
Jul 13 04:06:00.619874 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.619623    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:06:00.638266 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:00.638206    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" podStartSLOduration=1.325387825 podStartE2EDuration="1.6381866s" totalImagesPullingTime="312.798775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:05:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:06:00.636840272 +0000 UTC m=+1479.412554554" watchObservedRunningTime="2026-07-13 04:06:00.6381866 +0000 UTC m=+1479.413900880"
Jul 13 04:06:01.223570 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:01.223536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:03.970778 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:03.970708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:04.264958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.264869    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:06:04.265176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.265146    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" podUID="477001e0-bceb-4238-b875-6a55c8ed3a60" containerName="maas-api" containerID="cri-o://d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3" gracePeriod=30
Jul 13 04:06:04.297987 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.297950    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:04.558368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.558340    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:06:04.653549 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.653509    2582 generic.go:356] "Generic (PLEG): container finished" podID="477001e0-bceb-4238-b875-6a55c8ed3a60" containerID="d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3" exitCode=0
Jul 13 04:06:04.653786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.653667    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" event={"ID":"477001e0-bceb-4238-b875-6a55c8ed3a60","Type":"ContainerDied","Data":"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"}
Jul 13 04:06:04.653786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.653722    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb" event={"ID":"477001e0-bceb-4238-b875-6a55c8ed3a60","Type":"ContainerDied","Data":"4a7ecab9b69e8cfa6561aa867d866d7518ea577000b954e72f607d3f5158f71a"}
Jul 13 04:06:04.653937 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.653849    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"
Jul 13 04:06:04.654204 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.653774    2582 scope.go:117] "RemoveContainer" containerID="d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"
Jul 13 04:06:04.663214 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.663191    2582 scope.go:117] "RemoveContainer" containerID="d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"
Jul 13 04:06:04.663513 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:04.663493    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3\": container with ID starting with d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3 not found: ID does not exist" containerID="d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"
Jul 13 04:06:04.663575 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.663523    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3"} err="failed to get container status \"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3\": rpc error: code = NotFound desc = could not find container \"d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3\": container with ID starting with d91d25939f2f6cf747d800c563ce0ffcca5a7e2d0cdc430edaeed3a405702cc3 not found: ID does not exist"
Jul 13 04:06:04.685342 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.685311    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca\") pod \"477001e0-bceb-4238-b875-6a55c8ed3a60\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") "
Jul 13 04:06:04.685464 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.685358    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") pod \"477001e0-bceb-4238-b875-6a55c8ed3a60\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") "
Jul 13 04:06:04.685464 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.685411    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtwbh\" (UniqueName: \"kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh\") pod \"477001e0-bceb-4238-b875-6a55c8ed3a60\" (UID: \"477001e0-bceb-4238-b875-6a55c8ed3a60\") "
Jul 13 04:06:04.685672 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.685648    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "477001e0-bceb-4238-b875-6a55c8ed3a60" (UID: "477001e0-bceb-4238-b875-6a55c8ed3a60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:06:04.687489 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.687460    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "477001e0-bceb-4238-b875-6a55c8ed3a60" (UID: "477001e0-bceb-4238-b875-6a55c8ed3a60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:06:04.687594 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.687541    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh" (OuterVolumeSpecName: "kube-api-access-rtwbh") pod "477001e0-bceb-4238-b875-6a55c8ed3a60" (UID: "477001e0-bceb-4238-b875-6a55c8ed3a60"). InnerVolumeSpecName "kube-api-access-rtwbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:04.786673 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.786565    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/477001e0-bceb-4238-b875-6a55c8ed3a60-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:04.786673 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.786602    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/477001e0-bceb-4238-b875-6a55c8ed3a60-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:04.786673 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.786612    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtwbh\" (UniqueName: \"kubernetes.io/projected/477001e0-bceb-4238-b875-6a55c8ed3a60-kube-api-access-rtwbh\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:04.975071 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.975033    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:06:04.977284 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:04.977262    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d88d530b-7c5fc596cb-fndrb"]
Jul 13 04:06:05.760869 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:05.760834    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="477001e0-bceb-4238-b875-6a55c8ed3a60" path="/var/lib/kubelet/pods/477001e0-bceb-4238-b875-6a55c8ed3a60/volumes"
Jul 13 04:06:09.679555 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.679515    2582 generic.go:356] "Generic (PLEG): container finished" podID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerID="1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b" exitCode=0
Jul 13 04:06:09.679985 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.679586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerDied","Data":"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"}
Jul 13 04:06:09.680027 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.680015    2582 scope.go:117] "RemoveContainer" containerID="1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"
Jul 13 04:06:09.681028 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.680997    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:09.681101 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.681084    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:09.681147 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.681132    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:09.989517 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:09.989478    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:06:10.009182 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:10.009146    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:10.112891 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:10.112859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:10.685719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:10.685683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerStarted","Data":"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"}
Jul 13 04:06:10.686278 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:10.685845    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy" containerID="cri-o://cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf" gracePeriod=30
Jul 13 04:06:12.717673 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:12.717634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:14.613454 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:14.613412    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:06:15.656182 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.656147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:15.756267 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.756231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:15.814991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.814911    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:15.815430 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.815412    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="477001e0-bceb-4238-b875-6a55c8ed3a60" containerName="maas-api"
Jul 13 04:06:15.815430 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.815432    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="477001e0-bceb-4238-b875-6a55c8ed3a60" containerName="maas-api"
Jul 13 04:06:15.815542 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.815508    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="477001e0-bceb-4238-b875-6a55c8ed3a60" containerName="maas-api"
Jul 13 04:06:15.818457 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.818440    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.821116 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.821086    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1a8eb751-openshift-default-dockercfg-kkt7c\""
Jul 13 04:06:15.832678 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.832654    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:15.849690 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.849656    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:15.895984 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.895957    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896016    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896059    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896074    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896344 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.896344 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.896185    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58dmn\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.908122 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.908057    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:15.956955 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.956929    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:06:15.996922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.996879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.996922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.996915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58dmn\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.996958    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997066    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997478 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997478 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997596 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997489    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997699 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997797 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997676    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.997939 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.997916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.999427 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.999403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:15.999774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:15.999756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:16.005009 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.004983    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:16.005275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.005253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58dmn\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn\") pod \"e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") " pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:16.098292 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098292 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098519 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098312    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098519 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098342    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8ddj\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098519 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098375    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098519 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098487    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098545    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098602    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:16.098774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token\") pod \"4ce48572-e277-4d67-addb-59d1d6d6e047\" (UID: \"4ce48572-e277-4d67-addb-59d1d6d6e047\") "
Jul 13 04:06:16.098774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098632    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:16.099032 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:16.099032 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.098952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:06:16.099143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.099073    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ce48572-e277-4d67-addb-59d1d6d6e047-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.099143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.099089    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.099143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.099103    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.099143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.099117    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.099434 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.099406    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:16.100744 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.100708    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:16.100847 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.100767    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:06:16.100847 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.100769    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:16.100847 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.100769    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj" (OuterVolumeSpecName: "kube-api-access-c8ddj") pod "4ce48572-e277-4d67-addb-59d1d6d6e047" (UID: "4ce48572-e277-4d67-addb-59d1d6d6e047"). InnerVolumeSpecName "kube-api-access-c8ddj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:16.132192 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.132158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:16.201176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.201000    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.201176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.201033    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8ddj\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-kube-api-access-c8ddj\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.201176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.201050    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.201176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.201069    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.201176 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.201084    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ce48572-e277-4d67-addb-59d1d6d6e047-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:16.272462 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.272432    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:16.275693 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:06:16.275668    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278aa37e_2917_4f44_9df3_b988b6f5e1d1.slice/crio-d85158b5a0fef266a611ab6ec30ebf751bd0911b4c8f9b121076d9b3c747acff WatchSource:0}: Error finding container d85158b5a0fef266a611ab6ec30ebf751bd0911b4c8f9b121076d9b3c747acff: Status 404 returned error can't find the container with id d85158b5a0fef266a611ab6ec30ebf751bd0911b4c8f9b121076d9b3c747acff
Jul 13 04:06:16.277713 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.277682    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:16.277814 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.277783    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:16.277858 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.277822    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:06:16.717778 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.717743    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" event={"ID":"278aa37e-2917-4f44-9df3-b988b6f5e1d1","Type":"ContainerStarted","Data":"e18cb8bf346f4659dcb813da9bd918911d5c069589c3aa4338520fcfe8c03a8d"}
Jul 13 04:06:16.718230 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.717807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" event={"ID":"278aa37e-2917-4f44-9df3-b988b6f5e1d1","Type":"ContainerStarted","Data":"d85158b5a0fef266a611ab6ec30ebf751bd0911b4c8f9b121076d9b3c747acff"}
Jul 13 04:06:16.719523 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.719495    2582 generic.go:356] "Generic (PLEG): container finished" podID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerID="cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf" exitCode=0
Jul 13 04:06:16.719633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.719536    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"
Jul 13 04:06:16.719633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.719542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerDied","Data":"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"}
Jul 13 04:06:16.719633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.719584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2" event={"ID":"4ce48572-e277-4d67-addb-59d1d6d6e047","Type":"ContainerDied","Data":"88ae892459de78b6493ac5a18b59d98cac22eaee2c82ef349a6ae77318b364fe"}
Jul 13 04:06:16.719633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.719611    2582 scope.go:117] "RemoveContainer" containerID="cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"
Jul 13 04:06:16.729474 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.729450    2582 scope.go:117] "RemoveContainer" containerID="1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"
Jul 13 04:06:16.737887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.737837    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" podStartSLOduration=1.737817612 podStartE2EDuration="1.737817612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:06:16.736029394 +0000 UTC m=+1495.511743672" watchObservedRunningTime="2026-07-13 04:06:16.737817612 +0000 UTC m=+1495.513531894"
Jul 13 04:06:16.738662 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.738617    2582 scope.go:117] "RemoveContainer" containerID="cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"
Jul 13 04:06:16.739001 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:16.738965    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf\": container with ID starting with cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf not found: ID does not exist" containerID="cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"
Jul 13 04:06:16.739096 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.738999    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf"} err="failed to get container status \"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf\": rpc error: code = NotFound desc = could not find container \"cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf\": container with ID starting with cc328e1e3f690069d15b6fd8beaf1d6678e7867c124d68543668790d0645e2cf not found: ID does not exist"
Jul 13 04:06:16.739096 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.739023    2582 scope.go:117] "RemoveContainer" containerID="1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"
Jul 13 04:06:16.739329 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:16.739305    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b\": container with ID starting with 1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b not found: ID does not exist" containerID="1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"
Jul 13 04:06:16.739382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.739336    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b"} err="failed to get container status \"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b\": rpc error: code = NotFound desc = could not find container \"1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b\": container with ID starting with 1fed2d86fc9bdd701011b5fe6ccaf2fdc5cfd5101c37703164df599b902f8f6b not found: ID does not exist"
Jul 13 04:06:16.749232 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.749209    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:06:16.752045 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.752026    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d88d530b-openshift-default-664bf6947f-kg5f2"]
Jul 13 04:06:16.965007 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:16.964924    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:17.056811 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.056780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:17.132160 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132127    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:17.132564 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132547    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.132653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132567    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.132653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132590    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.132653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132598    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.132895 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132683    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.132895 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.132696    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" containerName="istio-proxy"
Jul 13 04:06:17.137279 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.137257    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:17.137408 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.137362    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.138652 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.138632    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:17.140822 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.140803    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-1a8eb751-serving-cert\""
Jul 13 04:06:17.163659 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.163633    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:17.184439 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.184409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:17.212470 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.212438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.212602 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.212479    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.212602 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.212541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmfw4\" (UniqueName: \"kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.313461 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.313427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.313620 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.313480    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.313620 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.313529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmfw4\" (UniqueName: \"kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.313620 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:17.313580    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-serving-cert: secret "maas-api-e2e-derive-1a8eb751-serving-cert" not found
Jul 13 04:06:17.313847 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:17.313652    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls podName:c451a2cc-3b6f-4bff-85e4-00baeacf8a07 nodeName:}" failed. No retries permitted until 2026-07-13 04:06:17.813627406 +0000 UTC m=+1496.589341665 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls") pod "maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" (UID: "c451a2cc-3b6f-4bff-85e4-00baeacf8a07") : secret "maas-api-e2e-derive-1a8eb751-serving-cert" not found
Jul 13 04:06:17.314128 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.314110    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.327947 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.327924    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmfw4\" (UniqueName: \"kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.394247 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.394216    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:17.726175 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.726093    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:17.727156 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.727135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:17.733310 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.733289    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:17.762361 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.762333    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ce48572-e277-4d67-addb-59d1d6d6e047" path="/var/lib/kubelet/pods/4ce48572-e277-4d67-addb-59d1d6d6e047/volumes"
Jul 13 04:06:17.819134 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.819091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.821404 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.821383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") pod \"maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:17.831449 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:17.831426    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:18.047322 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.047241    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:18.183635 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.183608    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:18.185397 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:06:18.185371    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc451a2cc_3b6f_4bff_85e4_00baeacf8a07.slice/crio-c93e8175187f7c3fb8a68cf39ed4e6141cae1a1560884644d5f2e3113d976be2 WatchSource:0}: Error finding container c93e8175187f7c3fb8a68cf39ed4e6141cae1a1560884644d5f2e3113d976be2: Status 404 returned error can't find the container with id c93e8175187f7c3fb8a68cf39ed4e6141cae1a1560884644d5f2e3113d976be2
Jul 13 04:06:18.733172 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.733139    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" event={"ID":"c451a2cc-3b6f-4bff-85e4-00baeacf8a07","Type":"ContainerStarted","Data":"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"}
Jul 13 04:06:18.733531 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.733239    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" event={"ID":"c451a2cc-3b6f-4bff-85e4-00baeacf8a07","Type":"ContainerStarted","Data":"c93e8175187f7c3fb8a68cf39ed4e6141cae1a1560884644d5f2e3113d976be2"}
Jul 13 04:06:18.733531 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.733514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:18.749961 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:18.749914    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" podStartSLOduration=1.294477242 podStartE2EDuration="1.749898887s" totalImagesPullingTime="455.421645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:06:18.747828677 +0000 UTC m=+1497.523542956" watchObservedRunningTime="2026-07-13 04:06:18.749898887 +0000 UTC m=+1497.525613221"
Jul 13 04:06:19.270557 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:19.270524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:21.402708 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.402669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:21.599224 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.599189    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:21.599421 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.599395    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" podUID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" containerName="istio-proxy" containerID="cri-o://e18cb8bf346f4659dcb813da9bd918911d5c069589c3aa4338520fcfe8c03a8d" gracePeriod=30
Jul 13 04:06:21.629517 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.629476    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:21.725666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.725572    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:21.794635 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.794606    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:21.794972 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.794944    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" podUID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" containerName="maas-api" containerID="cri-o://c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e" gracePeriod=30
Jul 13 04:06:21.799224 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.799153    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:06:21.804482 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.804461    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:06:21.819893 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:21.819864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:22.102951 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.102923    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:22.262624 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.262534    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca\") pod \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") "
Jul 13 04:06:22.262624 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.262605    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmfw4\" (UniqueName: \"kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4\") pod \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") "
Jul 13 04:06:22.262875 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.262674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") pod \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\" (UID: \"c451a2cc-3b6f-4bff-85e4-00baeacf8a07\") "
Jul 13 04:06:22.262975 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.262953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c451a2cc-3b6f-4bff-85e4-00baeacf8a07" (UID: "c451a2cc-3b6f-4bff-85e4-00baeacf8a07"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:06:22.265138 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.265110    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4" (OuterVolumeSpecName: "kube-api-access-dmfw4") pod "c451a2cc-3b6f-4bff-85e4-00baeacf8a07" (UID: "c451a2cc-3b6f-4bff-85e4-00baeacf8a07"). InnerVolumeSpecName "kube-api-access-dmfw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:22.265558 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.265531    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c451a2cc-3b6f-4bff-85e4-00baeacf8a07" (UID: "c451a2cc-3b6f-4bff-85e4-00baeacf8a07"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:06:22.363666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.363632    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:22.363666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.363665    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmfw4\" (UniqueName: \"kubernetes.io/projected/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-kube-api-access-dmfw4\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:22.363888 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.363679    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c451a2cc-3b6f-4bff-85e4-00baeacf8a07-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:22.758931 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.758890    2582 generic.go:356] "Generic (PLEG): container finished" podID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" containerID="c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e" exitCode=0
Jul 13 04:06:22.759375 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.758936    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"
Jul 13 04:06:22.759375 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.758978    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" event={"ID":"c451a2cc-3b6f-4bff-85e4-00baeacf8a07","Type":"ContainerDied","Data":"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"}
Jul 13 04:06:22.759375 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.759036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl" event={"ID":"c451a2cc-3b6f-4bff-85e4-00baeacf8a07","Type":"ContainerDied","Data":"c93e8175187f7c3fb8a68cf39ed4e6141cae1a1560884644d5f2e3113d976be2"}
Jul 13 04:06:22.759375 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.759063    2582 scope.go:117] "RemoveContainer" containerID="c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"
Jul 13 04:06:22.768663 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.768646    2582 scope.go:117] "RemoveContainer" containerID="c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"
Jul 13 04:06:22.768903 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:06:22.768876    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e\": container with ID starting with c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e not found: ID does not exist" containerID="c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"
Jul 13 04:06:22.768961 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.768901    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e"} err="failed to get container status \"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e\": rpc error: code = NotFound desc = could not find container \"c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e\": container with ID starting with c99a67070821b707f7ff770769461e3ac88ac449300044df5003488b06a4613e not found: ID does not exist"
Jul 13 04:06:22.781934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.781904    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:22.785329 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:22.785307    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-1a8eb751-64f95f5677-tshcl"]
Jul 13 04:06:23.324034 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:23.323991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:23.760835 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:23.760754    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" path="/var/lib/kubelet/pods/c451a2cc-3b6f-4bff-85e4-00baeacf8a07/volumes"
Jul 13 04:06:27.417870 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.417823    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:27.479694 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.479655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:27.786837 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.786800    2582 generic.go:356] "Generic (PLEG): container finished" podID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" containerID="e18cb8bf346f4659dcb813da9bd918911d5c069589c3aa4338520fcfe8c03a8d" exitCode=0
Jul 13 04:06:27.787019 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.786853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" event={"ID":"278aa37e-2917-4f44-9df3-b988b6f5e1d1","Type":"ContainerDied","Data":"e18cb8bf346f4659dcb813da9bd918911d5c069589c3aa4338520fcfe8c03a8d"}
Jul 13 04:06:27.861669 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.861641    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:27.872828 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.872795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:27.909943 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.909914    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58dmn\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.909971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.909996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910025    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910085    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910383 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910156    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910383 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910182    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910383 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910209    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket\") pod \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\" (UID: \"278aa37e-2917-4f44-9df3-b988b6f5e1d1\") "
Jul 13 04:06:27.910383 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910349    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:27.910590 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910542    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:27.910590 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910561    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:27.910936 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.910786    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:27.911062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.911030    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:06:27.911062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.911038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:27.912250 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.912229    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn" (OuterVolumeSpecName: "kube-api-access-58dmn") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "kube-api-access-58dmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:27.912578 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.912559    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:06:27.912701 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.912684    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:06:27.912786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.912719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "278aa37e-2917-4f44-9df3-b988b6f5e1d1" (UID: "278aa37e-2917-4f44-9df3-b988b6f5e1d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:06:27.972509 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:27.972430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:28.011615 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011588    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58dmn\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-kube-api-access-58dmn\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011615 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011613    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011623    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011631    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011639    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011647    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/278aa37e-2917-4f44-9df3-b988b6f5e1d1-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011654    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.011827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.011662    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/278aa37e-2917-4f44-9df3-b988b6f5e1d1-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:06:28.025233 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.025202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:28.793798 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.793760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t" event={"ID":"278aa37e-2917-4f44-9df3-b988b6f5e1d1","Type":"ContainerDied","Data":"d85158b5a0fef266a611ab6ec30ebf751bd0911b4c8f9b121076d9b3c747acff"}
Jul 13 04:06:28.794232 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.793834    2582 scope.go:117] "RemoveContainer" containerID="e18cb8bf346f4659dcb813da9bd918911d5c069589c3aa4338520fcfe8c03a8d"
Jul 13 04:06:28.794232 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.793781    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"
Jul 13 04:06:28.817058 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.817032    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:28.818979 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:28.818958    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1a8eb751-openshift-default-7548c96555-pzf8t"]
Jul 13 04:06:29.394809 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:29.394758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:29.760464 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:29.760377    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" path="/var/lib/kubelet/pods/278aa37e-2917-4f44-9df3-b988b6f5e1d1/volumes"
Jul 13 04:06:34.926158 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:34.926126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:34.987433 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:34.987399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:35.423125 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:35.423088    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:35.525367 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:35.525332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:06:35.623933 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:06:35.623902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:01.566316 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:01.566231    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:07.209363 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:07.209326    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:07.314036 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:07.314002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:07.410064 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:07.410029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:22.454511 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:22.454475    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:23.338009 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:23.337966    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:29.038156 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:29.038118    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:29.095979 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:29.095936    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:29.218248 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:29.218167    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:29.912178 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:29.912141    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:32.913415 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:32.913381    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:39.762980 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:39.762943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:40.539694 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:40.539657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:46.274724 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:46.274677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:46.330054 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:46.330018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:46.416510 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:46.416470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:46.514240 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:46.514206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:46.616162 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:46.616129    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:47.354290 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:47.354250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:47.448889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:47.448854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:47.551808 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:47.551770    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:49.116611 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:49.116573    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:54.747091 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:54.747060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:54.801532 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:54.801499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:07:55.432978 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:07:55.432949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:01.147059 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.147029    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:01.199963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.199929    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:01.384926 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.384890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:01.670782 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.670720    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:01.671116 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671104    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" containerName="istio-proxy"
Jul 13 04:08:01.671161 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671118    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" containerName="istio-proxy"
Jul 13 04:08:01.671161 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671132    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" containerName="maas-api"
Jul 13 04:08:01.671161 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671138    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" containerName="maas-api"
Jul 13 04:08:01.671260 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671192    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="278aa37e-2917-4f44-9df3-b988b6f5e1d1" containerName="istio-proxy"
Jul 13 04:08:01.671260 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.671199    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c451a2cc-3b6f-4bff-85e4-00baeacf8a07" containerName="maas-api"
Jul 13 04:08:01.674147 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.674129    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.676515 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.676495    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a16f6cc0-openshift-default-dockercfg-vd465\""
Jul 13 04:08:01.690332 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.690306    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:01.694820 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.694799    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:01.841356 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841401    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841478    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841530    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841818 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrqnx\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.841818 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.841606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942373 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942373 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrqnx\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942373 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942471    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.942658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.943025 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.942946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.943112 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.943088    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.943211 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.943193    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.943285 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.943260    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.943341 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.943280    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.944778 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.944761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.945241 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.945221    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.952868 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.952833    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.952868 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.952853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrqnx\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx\") pod \"e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") " pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.984954 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.984903    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:01.994569 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:01.994532    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:02.131088 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.131061    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:02.132713 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:08:02.132682    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86b17ab_acdc_4c71_bb4c_6a6fe9d8f39c.slice/crio-90418440fc22b69a387155473848b6cde60c7071a40ced8a2c1183e187c66123 WatchSource:0}: Error finding container 90418440fc22b69a387155473848b6cde60c7071a40ced8a2c1183e187c66123: Status 404 returned error can't find the container with id 90418440fc22b69a387155473848b6cde60c7071a40ced8a2c1183e187c66123
Jul 13 04:08:02.134981 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.134945    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:02.135070 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.135016    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:02.135070 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.135043    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:02.226895 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.226791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerStarted","Data":"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"}
Jul 13 04:08:02.226895 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.226864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerStarted","Data":"90418440fc22b69a387155473848b6cde60c7071a40ced8a2c1183e187c66123"}
Jul 13 04:08:02.246032 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.245968    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" podStartSLOduration=1.245947608 podStartE2EDuration="1.245947608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:08:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:08:02.244897764 +0000 UTC m=+1601.020612049" watchObservedRunningTime="2026-07-13 04:08:02.245947608 +0000 UTC m=+1601.021661888"
Jul 13 04:08:02.985620 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:02.985590    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:03.990081 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:03.990052    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:04.236445 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.236413    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:04.237455 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.237433    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:04.350378 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.350317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:04.418670 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.418633    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:04.422660 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.422631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.424923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.424905    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a16f6cc0-serving-cert\""
Jul 13 04:08:04.429648 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.429624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:04.431283 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.431248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:04.494416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.494383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:04.565512 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.565476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.565703 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.565531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpg5l\" (UniqueName: \"kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.565703 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.565612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.666591 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.666487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.666790 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.666609    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.666790 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.666670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpg5l\" (UniqueName: \"kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.666790 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:08:04.666763    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-serving-cert: secret "maas-api-e2e-mt-a16f6cc0-serving-cert" not found
Jul 13 04:08:04.666971 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:08:04.666842    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls podName:69210006-557f-4fdd-ab86-2efc0c69899b nodeName:}" failed. No retries permitted until 2026-07-13 04:08:05.166825001 +0000 UTC m=+1603.942539260 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls") pod "maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" (UID: "69210006-557f-4fdd-ab86-2efc0c69899b") : secret "maas-api-e2e-mt-a16f6cc0-serving-cert" not found
Jul 13 04:08:04.667183 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.667162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.687800 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.687770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpg5l\" (UniqueName: \"kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:04.982034 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:04.981949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:05.080429 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.080401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:05.171655 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.171619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:05.174140 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.174115    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") pod \"maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:05.180785 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.180759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:05.336266 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.336230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:05.475946 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:05.475923    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:05.477879 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:08:05.477852    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69210006_557f_4fdd_ab86_2efc0c69899b.slice/crio-8e9c2353b96449022d38ad3cc359b051b28a7fa1a8572ddcfdcc92a3bf0a22bb WatchSource:0}: Error finding container 8e9c2353b96449022d38ad3cc359b051b28a7fa1a8572ddcfdcc92a3bf0a22bb: Status 404 returned error can't find the container with id 8e9c2353b96449022d38ad3cc359b051b28a7fa1a8572ddcfdcc92a3bf0a22bb
Jul 13 04:08:06.248076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:06.248037    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" event={"ID":"69210006-557f-4fdd-ab86-2efc0c69899b","Type":"ContainerStarted","Data":"8e9c2353b96449022d38ad3cc359b051b28a7fa1a8572ddcfdcc92a3bf0a22bb"}
Jul 13 04:08:07.254662 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:07.254619    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" event={"ID":"69210006-557f-4fdd-ab86-2efc0c69899b","Type":"ContainerStarted","Data":"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"}
Jul 13 04:08:07.255093 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:07.254691    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:07.271827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:07.271776    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" podStartSLOduration=2.3616235850000002 podStartE2EDuration="3.271761809s" totalImagesPullingTime="910.138224ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:08:07.270028941 +0000 UTC m=+1606.045743222" watchObservedRunningTime="2026-07-13 04:08:07.271761809 +0000 UTC m=+1606.047476088"
Jul 13 04:08:09.099432 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:09.099398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:09.483815 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:09.483661    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:09.577937 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:09.577901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:09.895889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:09.895857    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:13.266078 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:13.266046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:15.723562 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:15.723515    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:15.779958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:15.779923    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:16.122165 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.122126    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:16.446453 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.446334    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:16.446721 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.446611    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" podUID="69210006-557f-4fdd-ab86-2efc0c69899b" containerName="maas-api" containerID="cri-o://bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba" gracePeriod=30
Jul 13 04:08:16.455719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.455686    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:16.556778 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.556745    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:16.699522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.699453    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:16.773078 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.773044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpg5l\" (UniqueName: \"kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l\") pod \"69210006-557f-4fdd-ab86-2efc0c69899b\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") "
Jul 13 04:08:16.773511 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.773225    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") pod \"69210006-557f-4fdd-ab86-2efc0c69899b\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") "
Jul 13 04:08:16.773511 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.773291    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca\") pod \"69210006-557f-4fdd-ab86-2efc0c69899b\" (UID: \"69210006-557f-4fdd-ab86-2efc0c69899b\") "
Jul 13 04:08:16.773713 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.773688    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69210006-557f-4fdd-ab86-2efc0c69899b" (UID: "69210006-557f-4fdd-ab86-2efc0c69899b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:08:16.775237 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.775209    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l" (OuterVolumeSpecName: "kube-api-access-rpg5l") pod "69210006-557f-4fdd-ab86-2efc0c69899b" (UID: "69210006-557f-4fdd-ab86-2efc0c69899b"). InnerVolumeSpecName "kube-api-access-rpg5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:08:16.775331 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.775287    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69210006-557f-4fdd-ab86-2efc0c69899b" (UID: "69210006-557f-4fdd-ab86-2efc0c69899b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:08:16.874229 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.874184    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpg5l\" (UniqueName: \"kubernetes.io/projected/69210006-557f-4fdd-ab86-2efc0c69899b-kube-api-access-rpg5l\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:16.874229 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.874229    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69210006-557f-4fdd-ab86-2efc0c69899b-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:16.874434 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:16.874244    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69210006-557f-4fdd-ab86-2efc0c69899b-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:17.304627 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.304589    2582 generic.go:356] "Generic (PLEG): container finished" podID="69210006-557f-4fdd-ab86-2efc0c69899b" containerID="bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba" exitCode=0
Jul 13 04:08:17.304824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.304639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" event={"ID":"69210006-557f-4fdd-ab86-2efc0c69899b","Type":"ContainerDied","Data":"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"}
Jul 13 04:08:17.304824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.304651    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"
Jul 13 04:08:17.304824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.304684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62" event={"ID":"69210006-557f-4fdd-ab86-2efc0c69899b","Type":"ContainerDied","Data":"8e9c2353b96449022d38ad3cc359b051b28a7fa1a8572ddcfdcc92a3bf0a22bb"}
Jul 13 04:08:17.304824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.304706    2582 scope.go:117] "RemoveContainer" containerID="bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"
Jul 13 04:08:17.313650 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.313617    2582 scope.go:117] "RemoveContainer" containerID="bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"
Jul 13 04:08:17.313940 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:08:17.313922    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba\": container with ID starting with bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba not found: ID does not exist" containerID="bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"
Jul 13 04:08:17.314007 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.313949    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba"} err="failed to get container status \"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba\": rpc error: code = NotFound desc = could not find container \"bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba\": container with ID starting with bed830a714769ac724ac30af0bc9f437cb6a5d281b93cc2f4e23adb5544d24ba not found: ID does not exist"
Jul 13 04:08:17.330664 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.330631    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:17.333129 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.333104    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a16f6cc0-54c56d66cc-5sc62"]
Jul 13 04:08:17.761929 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:17.761897    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69210006-557f-4fdd-ab86-2efc0c69899b" path="/var/lib/kubelet/pods/69210006-557f-4fdd-ab86-2efc0c69899b/volumes"
Jul 13 04:08:18.312189 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.312158    2582 generic.go:356] "Generic (PLEG): container finished" podID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerID="f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85" exitCode=0
Jul 13 04:08:18.312693 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.312235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerDied","Data":"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"}
Jul 13 04:08:18.312779 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.312715    2582 scope.go:117] "RemoveContainer" containerID="f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"
Jul 13 04:08:18.313917 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.313885    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:18.314025 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.313953    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:18.314025 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:18.313989    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:19.237412 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:19.237373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:19.320091 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:19.320059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerStarted","Data":"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"}
Jul 13 04:08:19.985968 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:19.985931    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:19.987172 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:19.987141    2582 patch_prober.go:28] interesting pod/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 04:08:19.987302 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:19.987192    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 04:08:20.985275 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:20.985245    2582 patch_prober.go:28] interesting pod/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 04:08:20.985627 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:20.985295    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 04:08:21.985540 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:21.985499    2582 patch_prober.go:28] interesting pod/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 13 04:08:21.985982 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:21.985559    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 13 04:08:22.166268 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.166220    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:22.266649 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.266553    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:22.406944 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.406902    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:22.407153 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.407125    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy" containerID="cri-o://a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4" gracePeriod=30
Jul 13 04:08:22.440249 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.440211    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:22.756066 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.756022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:22.929677 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:22.929635    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:23.016572 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:23.016489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:28.255968 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.255941    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:28.267179 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267154    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267270 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267183    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267270 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267215    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267270 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267232    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267269    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrqnx\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267343    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267365    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267397    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo\") pod \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\" (UID: \"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c\") "
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267461    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267470    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267625    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267633    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267668    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.267683 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.267685    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.268238 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.268218    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:08:28.269516 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.269490    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx" (OuterVolumeSpecName: "kube-api-access-xrqnx") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "kube-api-access-xrqnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:08:28.269636 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.269618    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:08:28.269944 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.269921    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:08:28.270053 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.269925    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" (UID: "c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368803    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368828    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368838    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368848    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrqnx\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-kube-api-access-xrqnx\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368856    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368863    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.368883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.368871    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:08:28.373135 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.373108    2582 generic.go:356] "Generic (PLEG): container finished" podID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerID="a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4" exitCode=0
Jul 13 04:08:28.373269 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.373152    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"
Jul 13 04:08:28.373269 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.373186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerDied","Data":"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"}
Jul 13 04:08:28.373269 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.373235    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl" event={"ID":"c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c","Type":"ContainerDied","Data":"90418440fc22b69a387155473848b6cde60c7071a40ced8a2c1183e187c66123"}
Jul 13 04:08:28.373269 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.373257    2582 scope.go:117] "RemoveContainer" containerID="a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"
Jul 13 04:08:28.385107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.385089    2582 scope.go:117] "RemoveContainer" containerID="f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"
Jul 13 04:08:28.392949 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.392926    2582 scope.go:117] "RemoveContainer" containerID="a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"
Jul 13 04:08:28.393294 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:08:28.393270    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4\": container with ID starting with a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4 not found: ID does not exist" containerID="a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"
Jul 13 04:08:28.393370 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.393306    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4"} err="failed to get container status \"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4\": rpc error: code = NotFound desc = could not find container \"a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4\": container with ID starting with a4e77bb3ac2aee8e5a9057d1fe8186f496d7e0a0b2e8dfc2ac88f2a044cf26b4 not found: ID does not exist"
Jul 13 04:08:28.393370 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.393330    2582 scope.go:117] "RemoveContainer" containerID="f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"
Jul 13 04:08:28.393592 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:08:28.393573    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85\": container with ID starting with f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85 not found: ID does not exist" containerID="f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"
Jul 13 04:08:28.393654 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.393602    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85"} err="failed to get container status \"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85\": rpc error: code = NotFound desc = could not find container \"f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85\": container with ID starting with f0676bdc1868254365ff03ba2e746cf5dd61b42df535eadb7384e16411839a85 not found: ID does not exist"
Jul 13 04:08:28.395200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.395180    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:28.398788 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.398769    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a16f6cc0-openshift-default-c8c9f9d47-7hxfl"]
Jul 13 04:08:28.652118 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.652038    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:28.710334 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.710303    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:28.775296 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.775265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:28.875336 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.875308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:28.995199 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:28.995111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:29.760670 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:29.760634    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" path="/var/lib/kubelet/pods/c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c/volumes"
Jul 13 04:08:34.599027 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:34.598986    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:34.704888 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:34.704856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:41.394470 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.394431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:41.674848 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.674686    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:08:41.675242 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675221    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69210006-557f-4fdd-ab86-2efc0c69899b" containerName="maas-api"
Jul 13 04:08:41.675242 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675243    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="69210006-557f-4fdd-ab86-2efc0c69899b" containerName="maas-api"
Jul 13 04:08:41.675416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675267    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:41.675416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675275    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:41.675416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675367    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="69210006-557f-4fdd-ab86-2efc0c69899b" containerName="maas-api"
Jul 13 04:08:41.675416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675384    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:41.675416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.675397    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:41.679910 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.679890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.682395 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.682375    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c92dd209-openshift-default-dockercfg-kzgpf\""
Jul 13 04:08:41.690159 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.690135    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:08:41.704008 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.703987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:41.791923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.791888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.791923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.791926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792170 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.791945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792170 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792044    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792170 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792170 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792102    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792284    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.792382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.792315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdnr8\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893312 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893312 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893312    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893559 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893559 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893559 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893458    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893559 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdnr8\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893559 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893874 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893874 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893861    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893983 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.893983 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.893926    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.894228 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.894196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.894334 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.894279    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.894334 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.894316    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.896247 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.896222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.896760 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.896719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.903476 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.903449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.906430 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.906400    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdnr8\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8\") pod \"e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") " pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:41.941072 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.940993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:41.991924 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:41.991889    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:42.142192 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.142167    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:08:42.145019 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:08:42.144986    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1090d31_b136_4335_b6f8_36c2cb6fd1ec.slice/crio-9aaabb58fb7210e631a99ef96cca5746c07d8997a8adbfad9b502cd4f47fb4e4 WatchSource:0}: Error finding container 9aaabb58fb7210e631a99ef96cca5746c07d8997a8adbfad9b502cd4f47fb4e4: Status 404 returned error can't find the container with id 9aaabb58fb7210e631a99ef96cca5746c07d8997a8adbfad9b502cd4f47fb4e4
Jul 13 04:08:42.147438 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.147404    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:42.147514 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.147473    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:42.147514 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.147504    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:42.449143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.449036    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerStarted","Data":"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"}
Jul 13 04:08:42.449143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.449110    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerStarted","Data":"9aaabb58fb7210e631a99ef96cca5746c07d8997a8adbfad9b502cd4f47fb4e4"}
Jul 13 04:08:42.466566 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.466516    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podStartSLOduration=1.466500141 podStartE2EDuration="1.466500141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:08:42.465723172 +0000 UTC m=+1641.241437453" watchObservedRunningTime="2026-07-13 04:08:42.466500141 +0000 UTC m=+1641.242214420"
Jul 13 04:08:42.992419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:42.992382    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:43.997781 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:43.997752    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:44.403786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.403758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:44.457794 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.457759    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:44.458657 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.458638    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:44.526598 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.526534    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:08:44.527124 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.527104    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:44.527124 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.527124    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c86b17ab-acdc-4c71-bb4c-6a6fe9d8f39c" containerName="istio-proxy"
Jul 13 04:08:44.530539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.530518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.532867 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.532847    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-c92dd209-serving-cert\""
Jul 13 04:08:44.533979 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.533941    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:44.541112 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.541091    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:08:44.605876 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.605840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:44.621632 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.621297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.621632 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.621351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.621632 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.621465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dq6s\" (UniqueName: \"kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.709987 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.709905    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:44.722182 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.722154    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dq6s\" (UniqueName: \"kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.722323 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.722232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.722323 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.722252    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.722833 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.722814    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.724613 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.724593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.729708 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.729685    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dq6s\" (UniqueName: \"kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s\") pod \"maas-api-e2e-mt-c92dd209-774c9cd58-ccjts\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.845820 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.845788    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:44.987844 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:44.987748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:08:44.996197 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:08:44.996165    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfad3abfc_0908_45e3_965d_f050deb237be.slice/crio-871a17ac3e3e532e2880bc93fd8f36a94706da48d9fb45aee42649a16f7399bf WatchSource:0}: Error finding container 871a17ac3e3e532e2880bc93fd8f36a94706da48d9fb45aee42649a16f7399bf: Status 404 returned error can't find the container with id 871a17ac3e3e532e2880bc93fd8f36a94706da48d9fb45aee42649a16f7399bf
Jul 13 04:08:45.017806 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:45.017784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:45.118863 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:45.118825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:45.463783 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:45.463723    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" event={"ID":"fad3abfc-0908-45e3-965d-f050deb237be","Type":"ContainerStarted","Data":"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"}
Jul 13 04:08:45.464037 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:45.463809    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" event={"ID":"fad3abfc-0908-45e3-965d-f050deb237be","Type":"ContainerStarted","Data":"871a17ac3e3e532e2880bc93fd8f36a94706da48d9fb45aee42649a16f7399bf"}
Jul 13 04:08:45.479900 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:45.479856    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" podStartSLOduration=1.085168962 podStartE2EDuration="1.479842397s" totalImagesPullingTime="394.673435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:08:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:08:45.478827373 +0000 UTC m=+1644.254541656" watchObservedRunningTime="2026-07-13 04:08:45.479842397 +0000 UTC m=+1644.255556676"
Jul 13 04:08:46.469001 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:46.468965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:48.864691 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:48.864653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:08:52.479114 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:52.479084    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:08:58.527659 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.527547    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerID="35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c" exitCode=0
Jul 13 04:08:58.527659 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.527616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerDied","Data":"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"}
Jul 13 04:08:58.528197 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.528016    2582 scope.go:117] "RemoveContainer" containerID="35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"
Jul 13 04:08:58.529048 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.529020    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:58.529108 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.529090    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:58.529144 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:58.529120    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:08:59.458083 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:59.458047    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:59.537374 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:59.537332    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerStarted","Data":"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"}
Jul 13 04:08:59.992531 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:59.992490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:08:59.993798 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:59.993766    2582 patch_prober.go:28] interesting pod/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 04:08:59.993924 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:08:59.993831    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 04:09:00.993489 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:00.993454    2582 patch_prober.go:28] interesting pod/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 04:09:00.993887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:00.993519    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 04:09:01.992968 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:01.992937    2582 patch_prober.go:28] interesting pod/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 04:09:01.993160 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:01.992998    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 04:09:02.034777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:02.030196    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:02.992810 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:02.992772    2582 patch_prober.go:28] interesting pod/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 13 04:09:02.992999 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:02.992830    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 13 04:09:03.996035 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:03.995999    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:09:03.996435 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:03.996260    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:09:03.997185 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:03.997156    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:09:04.110301 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:04.110268    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:04.160924 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:04.160890    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:11.708579 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:11.708536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:11.810042 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:11.810007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:26.407007 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:26.406970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:26.885922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:26.885885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:26.986818 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:26.986778    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:27.115588 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.115556    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:09:27.115798 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.115775    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" podUID="fad3abfc-0908-45e3-965d-f050deb237be" containerName="maas-api" containerID="cri-o://1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5" gracePeriod=30
Jul 13 04:09:27.129253 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.129221    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:27.360950 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.360927    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:09:27.419029 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.418995    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls\") pod \"fad3abfc-0908-45e3-965d-f050deb237be\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") "
Jul 13 04:09:27.419469 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.419043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dq6s\" (UniqueName: \"kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s\") pod \"fad3abfc-0908-45e3-965d-f050deb237be\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") "
Jul 13 04:09:27.419469 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.419173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca\") pod \"fad3abfc-0908-45e3-965d-f050deb237be\" (UID: \"fad3abfc-0908-45e3-965d-f050deb237be\") "
Jul 13 04:09:27.419570 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.419525    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fad3abfc-0908-45e3-965d-f050deb237be" (UID: "fad3abfc-0908-45e3-965d-f050deb237be"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:09:27.421102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.421079    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s" (OuterVolumeSpecName: "kube-api-access-5dq6s") pod "fad3abfc-0908-45e3-965d-f050deb237be" (UID: "fad3abfc-0908-45e3-965d-f050deb237be"). InnerVolumeSpecName "kube-api-access-5dq6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:09:27.421159 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.421086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fad3abfc-0908-45e3-965d-f050deb237be" (UID: "fad3abfc-0908-45e3-965d-f050deb237be"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:09:27.520790 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.520676    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fad3abfc-0908-45e3-965d-f050deb237be-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:09:27.520790 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.520717    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dq6s\" (UniqueName: \"kubernetes.io/projected/fad3abfc-0908-45e3-965d-f050deb237be-kube-api-access-5dq6s\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:09:27.520790 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.520754    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fad3abfc-0908-45e3-965d-f050deb237be-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:09:27.679469 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.679433    2582 generic.go:356] "Generic (PLEG): container finished" podID="fad3abfc-0908-45e3-965d-f050deb237be" containerID="1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5" exitCode=0
Jul 13 04:09:27.679633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.679477    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"
Jul 13 04:09:27.679633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.679499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" event={"ID":"fad3abfc-0908-45e3-965d-f050deb237be","Type":"ContainerDied","Data":"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"}
Jul 13 04:09:27.679633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.679541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts" event={"ID":"fad3abfc-0908-45e3-965d-f050deb237be","Type":"ContainerDied","Data":"871a17ac3e3e532e2880bc93fd8f36a94706da48d9fb45aee42649a16f7399bf"}
Jul 13 04:09:27.679633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.679563    2582 scope.go:117] "RemoveContainer" containerID="1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"
Jul 13 04:09:27.688439 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.688423    2582 scope.go:117] "RemoveContainer" containerID="1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"
Jul 13 04:09:27.688698 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:09:27.688680    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5\": container with ID starting with 1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5 not found: ID does not exist" containerID="1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"
Jul 13 04:09:27.688761 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.688708    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5"} err="failed to get container status \"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5\": rpc error: code = NotFound desc = could not find container \"1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5\": container with ID starting with 1403b709fd39ec83650319a9ba8ab962b931d8b95c156fad72d7832a4b4745f5 not found: ID does not exist"
Jul 13 04:09:27.701553 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.701526    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:09:27.704951 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.704931    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-c92dd209-774c9cd58-ccjts"]
Jul 13 04:09:27.760109 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:27.760078    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fad3abfc-0908-45e3-965d-f050deb237be" path="/var/lib/kubelet/pods/fad3abfc-0908-45e3-965d-f050deb237be/volumes"
Jul 13 04:09:32.554518 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:32.554481    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:09:37.641413 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:09:37.641374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:13.728107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:13.728023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:14.591438 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:14.591402    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:20.256968 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:20.256928    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:20.500639 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:20.500610    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:10:20.500880 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:20.500858    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy" containerID="cri-o://2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65" gracePeriod=30
Jul 13 04:10:21.579470 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:21.579436    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:21.807895 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:21.807853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:21.907580 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:21.907486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:22.008883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:22.008831    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:22.717873 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:22.717840    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:22.819158 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:22.819125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:22.916030 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:22.915999    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:24.274678 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:24.274644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:25.781695 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.781668    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:10:25.838217 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838186    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdnr8\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838228    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838270    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838353    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838392    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838419 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838414    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838481    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data\") pod \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\" (UID: \"f1090d31-b136-4335-b6f8-36c2cb6fd1ec\") "
Jul 13 04:10:25.838786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838754    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:10:25.838957 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:10:25.838957 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838898    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.838957 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.838915    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.839114 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.839055    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:10:25.839460 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.839418    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:10:25.839613 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.839575    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:10:25.841069 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.841038    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8" (OuterVolumeSpecName: "kube-api-access-jdnr8") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "kube-api-access-jdnr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:10:25.841386 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.841358    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:10:25.841576 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.841554    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:10:25.841766 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.841719    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1090d31-b136-4335-b6f8-36c2cb6fd1ec" (UID: "f1090d31-b136-4335-b6f8-36c2cb6fd1ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:10:25.940288 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940241    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940288 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940288    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940304    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdnr8\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-kube-api-access-jdnr8\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940318    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940332    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940344    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.940538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.940357    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1090d31-b136-4335-b6f8-36c2cb6fd1ec-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:10:25.968773 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.968711    2582 generic.go:356] "Generic (PLEG): container finished" podID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerID="2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65" exitCode=0
Jul 13 04:10:25.968963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.968780    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"
Jul 13 04:10:25.968963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.968797    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerDied","Data":"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"}
Jul 13 04:10:25.968963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.968859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs" event={"ID":"f1090d31-b136-4335-b6f8-36c2cb6fd1ec","Type":"ContainerDied","Data":"9aaabb58fb7210e631a99ef96cca5746c07d8997a8adbfad9b502cd4f47fb4e4"}
Jul 13 04:10:25.968963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.968889    2582 scope.go:117] "RemoveContainer" containerID="2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"
Jul 13 04:10:25.980909 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.980893    2582 scope.go:117] "RemoveContainer" containerID="35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"
Jul 13 04:10:25.990058 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.990037    2582 scope.go:117] "RemoveContainer" containerID="2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"
Jul 13 04:10:25.990390 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:10:25.990360    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65\": container with ID starting with 2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65 not found: ID does not exist" containerID="2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"
Jul 13 04:10:25.990454 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.990403    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65"} err="failed to get container status \"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65\": rpc error: code = NotFound desc = could not find container \"2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65\": container with ID starting with 2d6efe51848f0314d34587a14c478a3163f7e0b7bf4c8d9ad5e675635890ef65 not found: ID does not exist"
Jul 13 04:10:25.990454 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.990426    2582 scope.go:117] "RemoveContainer" containerID="35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"
Jul 13 04:10:25.990792 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:10:25.990768    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c\": container with ID starting with 35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c not found: ID does not exist" containerID="35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"
Jul 13 04:10:25.990909 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.990797    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c"} err="failed to get container status \"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c\": rpc error: code = NotFound desc = could not find container \"35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c\": container with ID starting with 35d7b84185b3568d83aa3ceefe69858e13ec5d79ae01d2f05fe2d6247997b82c not found: ID does not exist"
Jul 13 04:10:25.996082 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.996051    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:10:25.998216 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:25.998195    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c92dd209-openshift-default-55b8546555-jq4hs"]
Jul 13 04:10:27.760285 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:27.760251    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" path="/var/lib/kubelet/pods/f1090d31-b136-4335-b6f8-36c2cb6fd1ec/volumes"
Jul 13 04:10:29.929985 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:29.929952    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:29.988747 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:29.988695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:30.596984 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:30.596916    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:36.964195 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:36.964152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:37.060553 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:37.060511    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:46.905974 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:46.905942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:10:47.253780 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:10:47.253673    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:08.231082 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:08.231043    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:13.861934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:13.861904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:13.924121 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:13.924092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:14.232291 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.232203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:14.516840 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.516687    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:11:14.517260 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517238    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:14.517337 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517262    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:14.517337 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517279    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fad3abfc-0908-45e3-965d-f050deb237be" containerName="maas-api"
Jul 13 04:11:14.517337 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517284    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fad3abfc-0908-45e3-965d-f050deb237be" containerName="maas-api"
Jul 13 04:11:14.517492 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517373    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:14.517492 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517382    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:14.517492 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.517389    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fad3abfc-0908-45e3-965d-f050deb237be" containerName="maas-api"
Jul 13 04:11:14.519404 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.519388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.521688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.521667    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-42c2d3-openshift-default-dockercfg-zcwbm\""
Jul 13 04:11:14.532046 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.532022    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:11:14.539501 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.539447    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:14.668456 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668456 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ktp5\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.668952 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.668696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.679526 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.679496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:14.770130 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770046    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ktp5\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770130 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770321 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770132    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770321 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770290    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770418 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770418 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770418 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770386    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770566 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770566 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770500    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770566 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770566 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770535    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.770843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.770821    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.771118 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.771095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.772674 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.772652    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.772893 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.772877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.777560 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.777539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.777631 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.777609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ktp5\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5\") pod \"e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") " pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.832580 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.832550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:14.975206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.975180    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:11:14.977346 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:11:14.977321    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e521353_798a_4d60_8108_2fde93576403.slice/crio-287242f6123dd9146ef1be9e9a7a6d4535472d372fa630d6f332620cb2cc55ca WatchSource:0}: Error finding container 287242f6123dd9146ef1be9e9a7a6d4535472d372fa630d6f332620cb2cc55ca: Status 404 returned error can't find the container with id 287242f6123dd9146ef1be9e9a7a6d4535472d372fa630d6f332620cb2cc55ca
Jul 13 04:11:14.979512 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.979477    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:14.979606 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.979548    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:14.979606 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:14.979578    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:15.205482 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:15.205449    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerStarted","Data":"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"}
Jul 13 04:11:15.205671 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:15.205508    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerStarted","Data":"287242f6123dd9146ef1be9e9a7a6d4535472d372fa630d6f332620cb2cc55ca"}
Jul 13 04:11:15.226922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:15.226869    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podStartSLOduration=1.226853676 podStartE2EDuration="1.226853676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:11:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:11:15.224847717 +0000 UTC m=+1794.000561998" watchObservedRunningTime="2026-07-13 04:11:15.226853676 +0000 UTC m=+1794.002568019"
Jul 13 04:11:15.832843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:15.832803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:16.837740 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:16.837697    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:17.140030 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.139926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:17.216522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.216492    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:17.217507 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.217491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:17.244186 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.244152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:17.303189 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.303155    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:11:17.303721 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.303702    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:17.303793 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.303742    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1090d31-b136-4335-b6f8-36c2cb6fd1ec" containerName="istio-proxy"
Jul 13 04:11:17.306437 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.306415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.308887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.308866    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-42c2d3-serving-cert\""
Jul 13 04:11:17.313774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.313718    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:11:17.337786 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.337757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:17.396643 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.396541    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.396643 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.396576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.396643 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.396610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glsw\" (UniqueName: \"kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.498030 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.497996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.498030 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.498034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.498272 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.498060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glsw\" (UniqueName: \"kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.498641 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.498619    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.500547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.500518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.505503 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.505480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glsw\" (UniqueName: \"kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw\") pod \"maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.521407 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.521373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:17.619335 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.619297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:17.756844 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:11:17.756809    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb739ea_2e35_46b4_b259_473880f1714d.slice/crio-a862666cf8402230806ab1e688df0510aae42b891040f82e7064739eccc9254c WatchSource:0}: Error finding container a862666cf8402230806ab1e688df0510aae42b891040f82e7064739eccc9254c: Status 404 returned error can't find the container with id a862666cf8402230806ab1e688df0510aae42b891040f82e7064739eccc9254c
Jul 13 04:11:17.758329 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.758306    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 04:11:17.760937 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.760914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:11:17.793711 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.793681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:17.895111 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:17.895078    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:18.223426 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:18.223382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" event={"ID":"5fb739ea-2e35-46b4-b259-473880f1714d","Type":"ContainerStarted","Data":"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"}
Jul 13 04:11:18.223660 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:18.223436    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" event={"ID":"5fb739ea-2e35-46b4-b259-473880f1714d","Type":"ContainerStarted","Data":"a862666cf8402230806ab1e688df0510aae42b891040f82e7064739eccc9254c"}
Jul 13 04:11:18.223660 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:18.223613    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:18.240076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:18.240027    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" podStartSLOduration=0.895435522 podStartE2EDuration="1.240009096s" totalImagesPullingTime="344.573574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:11:18.238786966 +0000 UTC m=+1797.014501248" watchObservedRunningTime="2026-07-13 04:11:18.240009096 +0000 UTC m=+1797.015723376"
Jul 13 04:11:21.637268 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:21.637233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:21.834140 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:21.834112    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:11:21.839603 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:21.839581    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:11:21.965789 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:21.965702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:22.227487 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.227411    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:11:22.231033 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.230953    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.235888 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.235860    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-88358a-openshift-default-dockercfg-5lmn4\""
Jul 13 04:11:22.242080 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.242058    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:11:22.259963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.259928    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:22.342152 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342110    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gck5d\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342346 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342346 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342484 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342484 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342484 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342421    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342484 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342718 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.342718 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.342529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443704 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gck5d\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.443919 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.443896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444131    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444385 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444214    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444385 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444464 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.444859 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.444837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.446370 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.446343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.446570 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.446555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.451703 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.451678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.451819 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.451721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gck5d\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d\") pod \"e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") " pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.545004 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.544916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:22.581902 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.581868    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:22.686630 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.686580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:11:22.688978 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:11:22.688951    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2d05f9_9dbf_43e2_b167_14cad4c18975.slice/crio-356c38ef14b0e168f082aca7b1af44dfcce4840b455a213ced5de81d26f9da67 WatchSource:0}: Error finding container 356c38ef14b0e168f082aca7b1af44dfcce4840b455a213ced5de81d26f9da67: Status 404 returned error can't find the container with id 356c38ef14b0e168f082aca7b1af44dfcce4840b455a213ced5de81d26f9da67
Jul 13 04:11:22.691596 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.691563    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:22.691697 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.691646    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:22.691789 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:22.691692    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:23.250946 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:23.250913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerStarted","Data":"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"}
Jul 13 04:11:23.251153 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:23.250966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerStarted","Data":"356c38ef14b0e168f082aca7b1af44dfcce4840b455a213ced5de81d26f9da67"}
Jul 13 04:11:23.271773 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:23.271705    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podStartSLOduration=1.271689944 podStartE2EDuration="1.271689944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:11:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:11:23.269626037 +0000 UTC m=+1802.045340318" watchObservedRunningTime="2026-07-13 04:11:23.271689944 +0000 UTC m=+1802.047404223"
Jul 13 04:11:23.545675 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:23.545588    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:23.550401 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:23.550376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:24.234578 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:24.234542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:11:24.255778 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:24.255723    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:24.256829 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:24.256793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:25.164007 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:25.163970    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:25.248063 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:25.247978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:25.313430 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:25.313397    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:25.819720 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:25.819683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:25.921666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:25.921634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:26.022858 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:26.022825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:29.685924 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:29.685877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:31.320154 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:31.320109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:32.218446 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.218349    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 04:11:32.218446 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.218417    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 04:11:32.299567 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.299533    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e521353-798a-4d60-8108-2fde93576403" containerID="6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8" exitCode=0
Jul 13 04:11:32.299750 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.299605    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerDied","Data":"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"}
Jul 13 04:11:32.300070 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.300056    2582 scope.go:117] "RemoveContainer" containerID="6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"
Jul 13 04:11:32.301086 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.301059    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:32.301143 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.301124    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:32.301179 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:32.301154    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:33.305945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:33.305907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerStarted","Data":"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"}
Jul 13 04:11:33.832788 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:33.832721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:33.833562 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:33.833090    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 04:11:33.833562 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:33.833278    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 04:11:34.833625 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:34.833580    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 04:11:34.834166 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:34.833702    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 04:11:35.833267 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:35.833227    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 04:11:35.833461 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:35.833298    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 04:11:36.833785 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:36.833746    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 13 04:11:36.834386 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:36.834352    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 13 04:11:37.837450 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:37.837418    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:37.837843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:37.837833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:37.838507 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:37.838481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:11:38.432334 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:38.432301    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:39.223524 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.223491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:39.257549 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.257518    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 13 04:11:39.257701 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.257566    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 13 04:11:39.298791 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.298760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:39.335540 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.335513    2582 generic.go:356] "Generic (PLEG): container finished" podID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerID="140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f" exitCode=0
Jul 13 04:11:39.335699 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.335591    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerDied","Data":"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"}
Jul 13 04:11:39.336102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.336086    2582 scope.go:117] "RemoveContainer" containerID="140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"
Jul 13 04:11:39.337231 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.337201    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:39.337335 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.337266    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:39.337335 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:39.337302    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:11:40.346072 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:40.346028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerStarted","Data":"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"}
Jul 13 04:11:40.546354 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:40.546307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:40.546561 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:40.546474    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 13 04:11:40.546561 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:40.546524    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 13 04:11:41.545455 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:41.545406    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 13 04:11:41.545987 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:41.545476    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 13 04:11:42.545811 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:42.545765    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 13 04:11:42.546327 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:42.545850    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 13 04:11:43.545804 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:43.545757    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 13 04:11:43.546036 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:43.545844    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 13 04:11:44.549783 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:44.549749    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:44.550268 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:44.550143    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:44.550960 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:44.550938    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:11:46.532093 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:46.532058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:11:46.635375 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:11:46.635340    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:16.307443 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:16.307410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:35.506928 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:35.506892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:35.555536 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:35.555504    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:38.394095 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:38.394060    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:39.272604 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:39.272568    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:39.445671 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:39.445642    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:39.848037 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:39.848002    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:39.952652 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:39.952620    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:40.091397 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.091140    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:12:40.091687 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.091651    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" podUID="5fb739ea-2e35-46b4-b259-473880f1714d" containerName="maas-api" containerID="cri-o://59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05" gracePeriod=30
Jul 13 04:12:40.100195 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.100165    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:12:40.338854 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.338828    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:12:40.506312 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.506226    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glsw\" (UniqueName: \"kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw\") pod \"5fb739ea-2e35-46b4-b259-473880f1714d\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") "
Jul 13 04:12:40.506312 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.506261    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca\") pod \"5fb739ea-2e35-46b4-b259-473880f1714d\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") "
Jul 13 04:12:40.506857 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.506324    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls\") pod \"5fb739ea-2e35-46b4-b259-473880f1714d\" (UID: \"5fb739ea-2e35-46b4-b259-473880f1714d\") "
Jul 13 04:12:40.506857 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.506702    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fb739ea-2e35-46b4-b259-473880f1714d" (UID: "5fb739ea-2e35-46b4-b259-473880f1714d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:12:40.508302 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.508276    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw" (OuterVolumeSpecName: "kube-api-access-5glsw") pod "5fb739ea-2e35-46b4-b259-473880f1714d" (UID: "5fb739ea-2e35-46b4-b259-473880f1714d"). InnerVolumeSpecName "kube-api-access-5glsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:12:40.508417 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.508332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fb739ea-2e35-46b4-b259-473880f1714d" (UID: "5fb739ea-2e35-46b4-b259-473880f1714d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 04:12:40.607809 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.607776    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glsw\" (UniqueName: \"kubernetes.io/projected/5fb739ea-2e35-46b4-b259-473880f1714d-kube-api-access-5glsw\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:12:40.607809 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.607803    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fb739ea-2e35-46b4-b259-473880f1714d-openshift-service-ca\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:12:40.607809 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.607812    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fb739ea-2e35-46b4-b259-473880f1714d-maas-api-tls\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:12:40.644253 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.644218    2582 generic.go:356] "Generic (PLEG): container finished" podID="5fb739ea-2e35-46b4-b259-473880f1714d" containerID="59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05" exitCode=0
Jul 13 04:12:40.644420 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.644263    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"
Jul 13 04:12:40.644420 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.644308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" event={"ID":"5fb739ea-2e35-46b4-b259-473880f1714d","Type":"ContainerDied","Data":"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"}
Jul 13 04:12:40.644420 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.644357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc" event={"ID":"5fb739ea-2e35-46b4-b259-473880f1714d","Type":"ContainerDied","Data":"a862666cf8402230806ab1e688df0510aae42b891040f82e7064739eccc9254c"}
Jul 13 04:12:40.644420 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.644379    2582 scope.go:117] "RemoveContainer" containerID="59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"
Jul 13 04:12:40.653273 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.653255    2582 scope.go:117] "RemoveContainer" containerID="59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"
Jul 13 04:12:40.653517 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:12:40.653497    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05\": container with ID starting with 59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05 not found: ID does not exist" containerID="59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"
Jul 13 04:12:40.653585 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.653524    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05"} err="failed to get container status \"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05\": rpc error: code = NotFound desc = could not find container \"59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05\": container with ID starting with 59ab0a0d8cfc11b07b8e16074e52e54e997bdb09ff43c66d7685489cbf549f05 not found: ID does not exist"
Jul 13 04:12:40.664944 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.664918    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:12:40.668922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:40.668900    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-42c2d3-79c7497c95-hxcvc"]
Jul 13 04:12:41.760117 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:41.760086    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fb739ea-2e35-46b4-b259-473880f1714d" path="/var/lib/kubelet/pods/5fb739ea-2e35-46b4-b259-473880f1714d/volumes"
Jul 13 04:12:44.938023 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:12:44.937942    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:21.676046 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:21.676011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:21.927653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:21.927567    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:13:21.927892 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:21.927851    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" containerID="cri-o://29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867" gracePeriod=30
Jul 13 04:13:21.947894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:21.947866    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:22.499835 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:22.499802    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:22.839826 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:22.839788    2582 patch_prober.go:28] interesting pod/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 04:13:22.840269 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:22.839874    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 04:13:22.865804 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:22.865776    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:22.966456 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:22.966423    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:23.067785 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:23.067750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:23.171866 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:23.171787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:27.177200 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.177168    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:13:27.316295 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316266    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316454 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316318    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316454 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316438    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316545 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316470    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316545 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316508    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ktp5\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316637 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316618    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316637 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316621    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:27.316777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316648    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316685    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316710    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data\") pod \"5e521353-798a-4d60-8108-2fde93576403\" (UID: \"5e521353-798a-4d60-8108-2fde93576403\") "
Jul 13 04:13:27.316777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316762    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:27.316984 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.316857    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:13:27.317056 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.317015    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:27.317115 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.317051    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.317115 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.317070    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e521353-798a-4d60-8108-2fde93576403-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.317115 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.317089    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.317601 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.317579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:27.318762 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.318702    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:13:27.318887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.318815    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5" (OuterVolumeSpecName: "kube-api-access-7ktp5") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "kube-api-access-7ktp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:13:27.318991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.318974    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:27.319049 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.318977    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e521353-798a-4d60-8108-2fde93576403" (UID: "5e521353-798a-4d60-8108-2fde93576403"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:13:27.417800 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417754    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.417800 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417794    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ktp5\" (UniqueName: \"kubernetes.io/projected/5e521353-798a-4d60-8108-2fde93576403-kube-api-access-7ktp5\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.417800 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417804    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e521353-798a-4d60-8108-2fde93576403-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.417800 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417813    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.418046 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417823    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.418046 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.417831    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e521353-798a-4d60-8108-2fde93576403-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:27.881506 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.881464    2582 generic.go:356] "Generic (PLEG): container finished" podID="5e521353-798a-4d60-8108-2fde93576403" containerID="29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867" exitCode=0
Jul 13 04:13:27.881666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.881521    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"
Jul 13 04:13:27.881666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.881543    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerDied","Data":"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"}
Jul 13 04:13:27.881666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.881597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn" event={"ID":"5e521353-798a-4d60-8108-2fde93576403","Type":"ContainerDied","Data":"287242f6123dd9146ef1be9e9a7a6d4535472d372fa630d6f332620cb2cc55ca"}
Jul 13 04:13:27.881666 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.881622    2582 scope.go:117] "RemoveContainer" containerID="29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"
Jul 13 04:13:27.890278 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.890262    2582 scope.go:117] "RemoveContainer" containerID="6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"
Jul 13 04:13:27.898651 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.898056    2582 scope.go:117] "RemoveContainer" containerID="29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"
Jul 13 04:13:27.898651 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:13:27.898495    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867\": container with ID starting with 29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867 not found: ID does not exist" containerID="29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"
Jul 13 04:13:27.898651 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.898531    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867"} err="failed to get container status \"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867\": rpc error: code = NotFound desc = could not find container \"29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867\": container with ID starting with 29fe8d27786eb5662d7e85f1edd8a718be9ed9ece08977a482c7a39c2b22d867 not found: ID does not exist"
Jul 13 04:13:27.898651 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.898554    2582 scope.go:117] "RemoveContainer" containerID="6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"
Jul 13 04:13:27.898940 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:13:27.898863    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8\": container with ID starting with 6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8 not found: ID does not exist" containerID="6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"
Jul 13 04:13:27.898940 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.898894    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8"} err="failed to get container status \"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8\": rpc error: code = NotFound desc = could not find container \"6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8\": container with ID starting with 6928bdd380d67f1504e096d5f47c586e11782f5b3bca2ad29d25357ff4646bf8 not found: ID does not exist"
Jul 13 04:13:27.899049 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.898996    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:13:27.900768 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:27.900747    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-42c2d3-openshift-default-8689bf9885-6njhn"]
Jul 13 04:13:28.728819 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:28.728789    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:28.827884 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:28.827851    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:29.028403 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.028324    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:13:29.028590 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.028566    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" containerID="cri-o://a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51" gracePeriod=30
Jul 13 04:13:29.069643 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.069605    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:29.552607 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.552570    2582 patch_prober.go:28] interesting pod/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 13 04:13:29.552839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.552632    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 04:13:29.580201 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.580174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:29.761289 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.761259    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e521353-798a-4d60-8108-2fde93576403" path="/var/lib/kubelet/pods/5e521353-798a-4d60-8108-2fde93576403/volumes"
Jul 13 04:13:29.869807 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.869780    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:13:29.870218 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870199    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fb739ea-2e35-46b4-b259-473880f1714d" containerName="maas-api"
Jul 13 04:13:29.870294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870222    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fb739ea-2e35-46b4-b259-473880f1714d" containerName="maas-api"
Jul 13 04:13:29.870294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870245    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:29.870294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870251    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:29.870294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870257    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:29.870294 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870262    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:29.870543 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870341    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:29.870543 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.870356    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fb739ea-2e35-46b4-b259-473880f1714d" containerName="maas-api"
Jul 13 04:13:29.873707 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.873685    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:29.877570 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.877546    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5e78fc-openshift-default-dockercfg-dj56v\""
Jul 13 04:13:29.889236 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.889208    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:13:29.911210 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:29.911171    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:30.040658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040623    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.040658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.040889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.040889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5md9q\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.040889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.040889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.041106 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.040964    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.041106 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.041015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.041106 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.041048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142465 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142381    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142465 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142465 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142465 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5md9q\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142491    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.142839 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142614    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.143108 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.142868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.143164 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.143137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.143336 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.143313    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.143537 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.143511    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.143629 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.143612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.144984 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.144962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.145078 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.145001    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.150472 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.150448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.151005 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.150986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5md9q\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q\") pod \"e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") " pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.184365 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.184346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:30.340163 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.340140    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:13:30.342428 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:13:30.342389    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad3595d_a311_4cfa_b8d9_b5e86e89a4f6.slice/crio-d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff WatchSource:0}: Error finding container d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff: Status 404 returned error can't find the container with id d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff
Jul 13 04:13:30.342677 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.342596    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:30.344760 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.344713    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:30.344843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.344820    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:30.344883 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.344848    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:30.905539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.905495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerStarted","Data":"5fb763e0f84cde5b213c69bdb5ef7d663ece9cc56649dc24e064800f8fcf2c1e"}
Jul 13 04:13:30.905539 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.905547    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerStarted","Data":"d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff"}
Jul 13 04:13:30.925682 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:30.925627    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podStartSLOduration=1.925611481 podStartE2EDuration="1.925611481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:13:30.923428489 +0000 UTC m=+1929.699142768" watchObservedRunningTime="2026-07-13 04:13:30.925611481 +0000 UTC m=+1929.701325761"
Jul 13 04:13:31.184782 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:31.184678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:31.189672 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:31.189639    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:31.910215 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:31.910185    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:31.911199 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:31.911182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:32.826501 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:32.826465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:32.908697 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:32.908662    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:32.973059 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:32.973028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:33.243427 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:33.243332    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:33.470358 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:33.470325    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:33.571117 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:33.571086    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:34.283686 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.283664    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:13:34.381716 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.381647    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.381906 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.381756    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.381906 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.381900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gck5d\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.381987 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.381931    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.381987 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.381968    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.382080 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382022    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.382080 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.382172 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382092    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.382172 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:34.382172 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382116    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy\") pod \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\" (UID: \"1c2d05f9-9dbf-43e2-b167-14cad4c18975\") "
Jul 13 04:13:34.382365 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382337    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:34.382365 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382346    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:13:34.382477 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382424    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:34.382477 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382439    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.382477 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382461    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.382690 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.382670    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:34.384114 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.384089    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d" (OuterVolumeSpecName: "kube-api-access-gck5d") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "kube-api-access-gck5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:13:34.384283 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.384269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:13:34.384547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.384523    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:13:34.384633 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.384544    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c2d05f9-9dbf-43e2-b167-14cad4c18975" (UID: "1c2d05f9-9dbf-43e2-b167-14cad4c18975"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:13:34.483204 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483173    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483204 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483202    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483211    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483221    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483229    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483238    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gck5d\" (UniqueName: \"kubernetes.io/projected/1c2d05f9-9dbf-43e2-b167-14cad4c18975-kube-api-access-gck5d\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.483368 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.483247    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2d05f9-9dbf-43e2-b167-14cad4c18975-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:13:34.927815 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.927783    2582 generic.go:356] "Generic (PLEG): container finished" podID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerID="a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51" exitCode=0
Jul 13 04:13:34.927982 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.927824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerDied","Data":"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"}
Jul 13 04:13:34.927982 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.927848    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"
Jul 13 04:13:34.927982 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.927866    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb" event={"ID":"1c2d05f9-9dbf-43e2-b167-14cad4c18975","Type":"ContainerDied","Data":"356c38ef14b0e168f082aca7b1af44dfcce4840b455a213ced5de81d26f9da67"}
Jul 13 04:13:34.927982 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.927891    2582 scope.go:117] "RemoveContainer" containerID="a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"
Jul 13 04:13:34.937815 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.937795    2582 scope.go:117] "RemoveContainer" containerID="140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"
Jul 13 04:13:34.945846 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.945824    2582 scope.go:117] "RemoveContainer" containerID="a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"
Jul 13 04:13:34.946068 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:13:34.946049    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51\": container with ID starting with a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51 not found: ID does not exist" containerID="a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"
Jul 13 04:13:34.946115 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.946076    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51"} err="failed to get container status \"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51\": rpc error: code = NotFound desc = could not find container \"a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51\": container with ID starting with a7e74c7d404a70e5e5643b67c8acc135422f5ef67436dec3a0591b77f6e8db51 not found: ID does not exist"
Jul 13 04:13:34.946115 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.946093    2582 scope.go:117] "RemoveContainer" containerID="140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"
Jul 13 04:13:34.946360 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:13:34.946341    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f\": container with ID starting with 140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f not found: ID does not exist" containerID="140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"
Jul 13 04:13:34.946414 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.946366    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f"} err="failed to get container status \"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f\": rpc error: code = NotFound desc = could not find container \"140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f\": container with ID starting with 140a813f3946d6d7a7681b773dd17031b3d72facc319f1bc3103b68defda912f not found: ID does not exist"
Jul 13 04:13:34.949226 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.949204    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:13:34.953445 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:34.953421    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-88358a-openshift-default-5dff6dc7b9-cgkpb"]
Jul 13 04:13:35.760859 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:35.760828    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" path="/var/lib/kubelet/pods/1c2d05f9-9dbf-43e2-b167-14cad4c18975/volumes"
Jul 13 04:13:37.337638 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:37.337601    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:37.798035 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:37.797957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:38.077620 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.077589    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:13:38.078149 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078132    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:13:38.078206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078152    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:13:38.078206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078175    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:13:38.078206 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078184    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:13:38.078310 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078279    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:13:38.078310 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.078292    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e521353-798a-4d60-8108-2fde93576403" containerName="istio-proxy"
Jul 13 04:13:38.082857 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.082833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.085208 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.085164    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5c775a-openshift-default-dockercfg-xgd9c\""
Jul 13 04:13:38.093617 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.093594    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:13:38.111562 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.111541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:38.114928 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.114905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115041 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.114942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115041 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.114985    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115041 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdc94\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115212 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115068    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115212 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115212 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115366 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.115366 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.115300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.174134 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.174100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:38.215757 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.215715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdc94\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.215923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.215779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.215923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.215809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.215923 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.215843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.215968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216246 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216246 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216359 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216359 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216470 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216531 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.216690 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.216669    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.218276 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.218258    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.218348 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.218333    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.223057 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.223026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.223698 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.223653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdc94\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94\") pod \"e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") " pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.396202 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.396117    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:38.529102 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.529075    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:13:38.531217 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:13:38.531186    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02448204_140c_48c0_a948_e028793441f3.slice/crio-3f726b3c6b25ac0d9eac832255d8fc72a219ef3415f941ef6f88d9ac6f299d84 WatchSource:0}: Error finding container 3f726b3c6b25ac0d9eac832255d8fc72a219ef3415f941ef6f88d9ac6f299d84: Status 404 returned error can't find the container with id 3f726b3c6b25ac0d9eac832255d8fc72a219ef3415f941ef6f88d9ac6f299d84
Jul 13 04:13:38.533343 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.533308    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:38.533438 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.533372    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:38.533438 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.533399    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:38.955249 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.955198    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerStarted","Data":"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"}
Jul 13 04:13:38.955416 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.955294    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerStarted","Data":"3f726b3c6b25ac0d9eac832255d8fc72a219ef3415f941ef6f88d9ac6f299d84"}
Jul 13 04:13:38.975493 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:38.975438    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podStartSLOduration=0.97542445 podStartE2EDuration="975.42445ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:13:38.973900052 +0000 UTC m=+1937.749614333" watchObservedRunningTime="2026-07-13 04:13:38.97542445 +0000 UTC m=+1937.751138729"
Jul 13 04:13:39.396896 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:39.396854    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:39.402170 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:39.402146    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:39.959957 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:39.959925    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:39.960841 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:39.960820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:40.885740 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:40.885692    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:40.964460 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:40.964425    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:41.028218 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:41.028184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:41.363120 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:41.363089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:41.569066 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:41.569032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:41.680554 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:41.680465    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:45.404077 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:45.404047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:47.951935 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:47.951892    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 04:13:47.952410 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:47.952014    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 04:13:49.006327 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.006276    2582 generic.go:356] "Generic (PLEG): container finished" podID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerID="5fb763e0f84cde5b213c69bdb5ef7d663ece9cc56649dc24e064800f8fcf2c1e" exitCode=0
Jul 13 04:13:49.006846 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.006405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerDied","Data":"5fb763e0f84cde5b213c69bdb5ef7d663ece9cc56649dc24e064800f8fcf2c1e"}
Jul 13 04:13:49.006931 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.006912    2582 scope.go:117] "RemoveContainer" containerID="5fb763e0f84cde5b213c69bdb5ef7d663ece9cc56649dc24e064800f8fcf2c1e"
Jul 13 04:13:49.007989 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.007955    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:49.008098 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.008039    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:49.008098 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:49.008088    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:50.013094 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:50.013058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerStarted","Data":"eea54b6940656864ce040195db756228a96812aa9ff46aaeedaa5866abb719a2"}
Jul 13 04:13:50.185577 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:50.185536    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:50.185774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:50.185702    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 04:13:50.185822 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:50.185792    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 04:13:51.185126 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:51.185086    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 04:13:51.185532 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:51.185158    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 04:13:52.185343 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:52.185307    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 04:13:52.185785 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:52.185375    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 04:13:53.185486 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:53.185452    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 04:13:53.185959 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:53.185523    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 04:13:53.595653 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:53.595619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:54.021521 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.021434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:54.119777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.119737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:54.185075 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.185038    2582 patch_prober.go:28] interesting pod/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Jul 13 04:13:54.185241 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.185093    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Jul 13 04:13:54.220686 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.220653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:54.384870 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:54.384826    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:55.188771 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:55.188721    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:55.189124 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:55.189100    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:55.189905 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:55.189883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:13:56.001866 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:56.001833    2582 patch_prober.go:28] interesting pod/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 04:13:56.002301 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:56.001910    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 04:13:57.062551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.062520    2582 generic.go:356] "Generic (PLEG): container finished" podID="02448204-140c-48c0-a948-e028793441f3" containerID="4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2" exitCode=0
Jul 13 04:13:57.063012 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.062597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerDied","Data":"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"}
Jul 13 04:13:57.063139 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.063122    2582 scope.go:117] "RemoveContainer" containerID="4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"
Jul 13 04:13:57.064246 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.064217    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:57.064303 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.064287    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:57.064342 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:57.064320    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:13:58.070327 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:58.070287    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerStarted","Data":"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"}
Jul 13 04:13:58.396837 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:58.396749    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:13:58.397006 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:58.396988    2582 patch_prober.go:28] interesting pod/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 13 04:13:58.397051 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:58.397031    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 13 04:13:59.396913 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.396875    2582 patch_prober.go:28] interesting pod/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 13 04:13:59.397355 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.396931    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 13 04:13:59.602189 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.602152    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:59.701712 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.701633    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:13:59.836094 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.836060    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:13:59.836550 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.836521    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy" containerID="cri-o://eea54b6940656864ce040195db756228a96812aa9ff46aaeedaa5866abb719a2" gracePeriod=30
Jul 13 04:13:59.860289 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:13:59.860248    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:00.250554 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.250515    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:00.397560 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.397526    2582 patch_prober.go:28] interesting pod/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 13 04:14:00.397978 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.397586    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 13 04:14:00.645909 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.645812    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:00.746147 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.746106    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:00.850522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.850486    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:00.946507 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:00.946379    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:01.397410 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:01.397377    2582 patch_prober.go:28] interesting pod/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 13 04:14:01.397578 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:01.397430    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 13 04:14:02.400323 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:02.400290    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:14:02.400688 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:02.400641    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:14:02.401432 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:02.401411    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:14:05.105922 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.105892    2582 generic.go:356] "Generic (PLEG): container finished" podID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerID="eea54b6940656864ce040195db756228a96812aa9ff46aaeedaa5866abb719a2" exitCode=0
Jul 13 04:14:05.106281 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.105959    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerDied","Data":"eea54b6940656864ce040195db756228a96812aa9ff46aaeedaa5866abb719a2"}
Jul 13 04:14:05.106281 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.106021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm" event={"ID":"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6","Type":"ContainerDied","Data":"d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff"}
Jul 13 04:14:05.106281 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.106044    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4ea0defac5bb31fd3d144e6f484c745e5a8ad1cdd5afa12855a2a31bd4c27ff"
Jul 13 04:14:05.106281 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.106060    2582 scope.go:117] "RemoveContainer" containerID="5fb763e0f84cde5b213c69bdb5ef7d663ece9cc56649dc24e064800f8fcf2c1e"
Jul 13 04:14:05.111671 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.111636    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:14:05.178637 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178601    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.178843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.178843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178707    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.178843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178759    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.178843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.179062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178861    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5md9q\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.179062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178887    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.179062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178915    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.179062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token\") pod \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\" (UID: \"dad3595d-a311-4cfa-b8d9-b5e86e89a4f6\") "
Jul 13 04:14:05.179062 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.178938    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:05.179307 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179150    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:05.179307 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179247    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:14:05.179307 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179281    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.179307 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179304    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.179499 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179362    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:05.179852 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.179831    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:05.181393 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.181368    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:14:05.181468 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.181395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:14:05.181468 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.181375    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q" (OuterVolumeSpecName: "kube-api-access-5md9q") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "kube-api-access-5md9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:14:05.181468 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.181432    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" (UID: "dad3595d-a311-4cfa-b8d9-b5e86e89a4f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:05.280137 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280095    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280137 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280123    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280137 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280133    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280137 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280142    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280137 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280151    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5md9q\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-kube-api-access-5md9q\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280558 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280160    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:05.280558 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:05.280167    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:06.111943 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.111917    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"
Jul 13 04:14:06.142428 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.142392    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:14:06.144512 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.144494    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5e78fc-openshift-default-67577b6fbc-dbkdm"]
Jul 13 04:14:06.380081 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.379964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:06.451977 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.451943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:06.691213 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.691134    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:14:06.691382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.691346    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy" containerID="cri-o://af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16" gracePeriod=30
Jul 13 04:14:06.716671 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:06.716614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:07.219889 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.219844    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:07.484154 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484067    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:14:07.484437 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484423    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.484437 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484437    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.484551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484450    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.484551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484456    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.484551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484507    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.484551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484516    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2d05f9-9dbf-43e2-b167-14cad4c18975" containerName="istio-proxy"
Jul 13 04:14:07.484551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.484524    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" containerName="istio-proxy"
Jul 13 04:14:07.487642 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.487620    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.490052 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.490031    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-694c02-openshift-default-dockercfg-s6zh7\""
Jul 13 04:14:07.499478 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.499453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:14:07.516872 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.516839    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:07.590868 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.590829    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:07.603106 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603219    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbrp8\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.603522 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.603420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704705 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704792    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704825    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbrp8\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.704912 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705251 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705251 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.704954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705251 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.705123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705251 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.705191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705446 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.705395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705446 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.705409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.705598 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.705577    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.707087 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.707063    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.707351 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.707330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.712467 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.712445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbrp8\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.712663 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.712645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token\") pod \"e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") " pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.760932 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.760869    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad3595d-a311-4cfa-b8d9-b5e86e89a4f6" path="/var/lib/kubelet/pods/dad3595d-a311-4cfa-b8d9-b5e86e89a4f6/volumes"
Jul 13 04:14:07.800091 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.800068    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:07.930466 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.930443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:14:07.932790 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:14:07.932762    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f816ec9_9c7a_4d79_b22a_dbd9bf880d57.slice/crio-fffa56a39883ed7b7f35f97a27b445b72d0cbdd4b2904152dc59b4de5da7d0e2 WatchSource:0}: Error finding container fffa56a39883ed7b7f35f97a27b445b72d0cbdd4b2904152dc59b4de5da7d0e2: Status 404 returned error can't find the container with id fffa56a39883ed7b7f35f97a27b445b72d0cbdd4b2904152dc59b4de5da7d0e2
Jul 13 04:14:07.934804 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.934767    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:07.934904 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.934846    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:07.934963 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:07.934915    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:08.123017 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:08.122982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerStarted","Data":"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"}
Jul 13 04:14:08.123177 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:08.123043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerStarted","Data":"fffa56a39883ed7b7f35f97a27b445b72d0cbdd4b2904152dc59b4de5da7d0e2"}
Jul 13 04:14:08.143321 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:08.143272    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podStartSLOduration=1.143256134 podStartE2EDuration="1.143256134s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:14:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:14:08.141286854 +0000 UTC m=+1966.917001133" watchObservedRunningTime="2026-07-13 04:14:08.143256134 +0000 UTC m=+1966.918970413"
Jul 13 04:14:08.801139 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:08.801100    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:08.806100 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:08.806079    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:09.127792 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:09.127758    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:09.128899 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:09.128881    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:10.052324 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.052291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:10.131824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.131793    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:10.196285 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.196252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:10.403393 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.403359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:10.598125 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.598093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:10.699182 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:10.699109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:11.962634 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:11.962575    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:14:12.144772 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.144723    2582 generic.go:356] "Generic (PLEG): container finished" podID="02448204-140c-48c0-a948-e028793441f3" containerID="af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16" exitCode=0
Jul 13 04:14:12.144934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.144784    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"
Jul 13 04:14:12.144934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.144830    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerDied","Data":"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"}
Jul 13 04:14:12.144934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.144891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp" event={"ID":"02448204-140c-48c0-a948-e028793441f3","Type":"ContainerDied","Data":"3f726b3c6b25ac0d9eac832255d8fc72a219ef3415f941ef6f88d9ac6f299d84"}
Jul 13 04:14:12.144934 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.144915    2582 scope.go:117] "RemoveContainer" containerID="af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"
Jul 13 04:14:12.148650 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148629    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148673    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdc94\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148777 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148760    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148779    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148833    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.148945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:12.148945 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148939    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.149201 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148963    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:12.149201 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.148978    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert\") pod \"02448204-140c-48c0-a948-e028793441f3\" (UID: \"02448204-140c-48c0-a948-e028793441f3\") "
Jul 13 04:14:12.149310 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.149280    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:12.149310 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.149287    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.149411 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.149321    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.149551 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.149524    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:14:12.149940 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.149910    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:12.151266 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.151241    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:14:12.151408 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.151390    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94" (OuterVolumeSpecName: "kube-api-access-rdc94") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "kube-api-access-rdc94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:14:12.151498 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.151481    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:14:12.151617 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.151600    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "02448204-140c-48c0-a948-e028793441f3" (UID: "02448204-140c-48c0-a948-e028793441f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:14:12.154550 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.154531    2582 scope.go:117] "RemoveContainer" containerID="4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"
Jul 13 04:14:12.169207 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.169188    2582 scope.go:117] "RemoveContainer" containerID="af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"
Jul 13 04:14:12.169480 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:14:12.169459    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16\": container with ID starting with af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16 not found: ID does not exist" containerID="af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"
Jul 13 04:14:12.169532 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.169488    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16"} err="failed to get container status \"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16\": rpc error: code = NotFound desc = could not find container \"af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16\": container with ID starting with af3a714a3d0cbb399f7ba9671c677461869bd36056842bed6cedacff134a0e16 not found: ID does not exist"
Jul 13 04:14:12.169532 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.169506    2582 scope.go:117] "RemoveContainer" containerID="4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"
Jul 13 04:14:12.169758 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:14:12.169718    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2\": container with ID starting with 4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2 not found: ID does not exist" containerID="4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"
Jul 13 04:14:12.169835 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.169760    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2"} err="failed to get container status \"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2\": rpc error: code = NotFound desc = could not find container \"4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2\": container with ID starting with 4a84ae7c0e980ac82d3c9531b832da1330a32a03d463644f8a347539e7ccc1a2 not found: ID does not exist"
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249794    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249824    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249836    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/02448204-140c-48c0-a948-e028793441f3-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249852    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/02448204-140c-48c0-a948-e028793441f3-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249865    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdc94\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-kube-api-access-rdc94\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.249882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249879    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/02448204-140c-48c0-a948-e028793441f3-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.250209 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.249891    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/02448204-140c-48c0-a948-e028793441f3-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:14:12.465504 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.465471    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:14:12.471937 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.471913    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5c775a-openshift-default-796bff5fb5-n54tp"]
Jul 13 04:14:12.680515 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.680487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:12.781635 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:12.781599    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:13.760345 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:13.760315    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02448204-140c-48c0-a948-e028793441f3" path="/var/lib/kubelet/pods/02448204-140c-48c0-a948-e028793441f3/volumes"
Jul 13 04:14:14.554640 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:14.554611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:14.911488 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:14.911398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:15.187207 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187134    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:14:15.187663 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187641    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:14:15.187663 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187663    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:14:15.187887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187677    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:14:15.187887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187685    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:14:15.187887 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.187797    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:14:15.190964 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.190947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.194177 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.194149    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-830ad7-openshift-default-dockercfg-8w4hm\""
Jul 13 04:14:15.202601 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.202578    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:14:15.219693 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.219665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:15.314824 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.314790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:15.375208 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375208 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375485 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375485 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375485 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5hqn\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375485 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375706 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375706 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.375706 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.375685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.476958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.476882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.476958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.476938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.476958 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.476959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.476980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5hqn\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477103    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477542 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477402    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477542 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477657 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477641    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477769 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.477854 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.477839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.479217 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.479196    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.479507 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.479490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.484363 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.484336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.484457 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.484379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5hqn\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn\") pod \"e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") " pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.503424 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.503404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:15.636092 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.636066    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:14:15.638048 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:14:15.638021    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008d6d29_1500_4fd8_87e6_78ba3ca34501.slice/crio-35c91a01b13cf570b7b16881e840b7baf9812479698fc5b424985e5efa4a08ae WatchSource:0}: Error finding container 35c91a01b13cf570b7b16881e840b7baf9812479698fc5b424985e5efa4a08ae: Status 404 returned error can't find the container with id 35c91a01b13cf570b7b16881e840b7baf9812479698fc5b424985e5efa4a08ae
Jul 13 04:14:15.640589 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.640555    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:15.640669 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.640630    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:15.640707 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:15.640664    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:16.168168 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:16.168129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerStarted","Data":"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"}
Jul 13 04:14:16.168545 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:16.168192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerStarted","Data":"35c91a01b13cf570b7b16881e840b7baf9812479698fc5b424985e5efa4a08ae"}
Jul 13 04:14:16.189764 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:16.189694    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podStartSLOduration=1.189677149 podStartE2EDuration="1.189677149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 04:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:14:16.187953174 +0000 UTC m=+1974.963667451" watchObservedRunningTime="2026-07-13 04:14:16.189677149 +0000 UTC m=+1974.965391429"
Jul 13 04:14:16.504320 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:16.504242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:16.509272 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:16.509246    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:17.173352 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:17.173321    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:17.174199 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:17.174178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:18.098376 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.098327    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:18.189837 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.189809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:18.340593 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.340555    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:18.750507 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.750470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:18.857660 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.857628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:18.952366 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:18.952334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:22.608757 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:22.608709    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:25.168965 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:25.168908    2582 patch_prober.go:28] interesting pod/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 13 04:14:25.169447 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:25.168994    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 13 04:14:26.218914 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.218877    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerID="241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61" exitCode=0
Jul 13 04:14:26.219348 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.218951    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerDied","Data":"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"}
Jul 13 04:14:26.219348 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.219335    2582 scope.go:117] "RemoveContainer" containerID="241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"
Jul 13 04:14:26.220315 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.220288    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:26.220366 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.220354    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:26.220409 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:26.220384    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:27.227636 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:27.226666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerStarted","Data":"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"}
Jul 13 04:14:27.801222 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:27.801194    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:27.801637 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:27.801617    2582 patch_prober.go:28] interesting pod/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 04:14:27.801836 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:27.801811    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 04:14:28.801324 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:28.801280    2582 patch_prober.go:28] interesting pod/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 04:14:28.801848 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:28.801348    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 04:14:29.800817 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:29.800776    2582 patch_prober.go:28] interesting pod/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 04:14:29.800975 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:29.800862    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 04:14:30.800717 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:30.800668    2582 patch_prober.go:28] interesting pod/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Jul 13 04:14:30.801142 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:30.800765    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Jul 13 04:14:31.804347 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:31.804312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:31.804774 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:31.804757    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:31.805490 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:31.805469    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:14:32.286586 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:32.286509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:32.387793 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:32.387759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:32.392376 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:32.392222    2582 patch_prober.go:28] interesting pod/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:49414->10.133.0.63:15021: read: connection reset by peer" start-of-body=
Jul 13 04:14:32.392376 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:32.392281    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": read tcp 10.133.0.2:49414->10.133.0.63:15021: read: connection reset by peer"
Jul 13 04:14:33.265714 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.265681    2582 generic.go:356] "Generic (PLEG): container finished" podID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerID="15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5" exitCode=0
Jul 13 04:14:33.266130 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.265760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerDied","Data":"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"}
Jul 13 04:14:33.266260 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.266244    2582 scope.go:117] "RemoveContainer" containerID="15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"
Jul 13 04:14:33.267293 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.267266    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:33.267361 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.267331    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:33.267404 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:33.267363    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 13 04:14:34.272270 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:34.272238    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerStarted","Data":"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"}
Jul 13 04:14:34.504530 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:34.504490    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:34.504881 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:34.504852    2582 patch_prober.go:28] interesting pod/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 13 04:14:34.505009 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:34.504904    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 13 04:14:35.504150 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:35.504118    2582 patch_prober.go:28] interesting pod/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 13 04:14:35.504547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:35.504171    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 13 04:14:36.504819 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:36.504783    2582 patch_prober.go:28] interesting pod/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 13 04:14:36.505215 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:36.504841    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 13 04:14:37.504363 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:37.504324    2582 patch_prober.go:28] interesting pod/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 13 04:14:37.504550 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:37.504386    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 13 04:14:38.506793 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:38.506764    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:38.507189 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:38.507163    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:38.507827 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:38.507810    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:14:39.449591 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:39.449563    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:14:39.549185 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:14:39.549148    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:16:21.861209 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:16:21.861131    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:16:21.867392 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:16:21.867369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rx4gx_f2d053e8-5c6a-4bc9-92da-eba0bf0f4809/ovn-acl-logging/0.log"
Jul 13 04:17:18.136723 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:18.136649    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:19.717699 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:19.717666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:27.544038 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:27.544006    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:28.051392 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:28.051359    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:28.139060 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:28.139022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:28.292367 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:28.292334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:33.659223 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:33.659192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:33.760125 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:33.760093    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:33.888882 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:33.888850    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:17:33.889112 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:33.889087    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy" containerID="cri-o://adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967" gracePeriod=30
Jul 13 04:17:33.907677 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:33.907646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:34.278951 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:34.278896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:34.679843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:34.679805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:34.832711 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:34.832677    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:34.931641 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:34.931558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:35.083806 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:35.083772    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:39.139519 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.139498    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:17:39.166253 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.166185    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerID="adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967" exitCode=0
Jul 13 04:17:39.166253 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.166222    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"
Jul 13 04:17:39.166427 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.166258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerDied","Data":"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"}
Jul 13 04:17:39.166427 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.166309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74" event={"ID":"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57","Type":"ContainerDied","Data":"fffa56a39883ed7b7f35f97a27b445b72d0cbdd4b2904152dc59b4de5da7d0e2"}
Jul 13 04:17:39.166427 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.166325    2582 scope.go:117] "RemoveContainer" containerID="adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"
Jul 13 04:17:39.174997 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.174965    2582 scope.go:117] "RemoveContainer" containerID="241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"
Jul 13 04:17:39.182909 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.182885    2582 scope.go:117] "RemoveContainer" containerID="adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"
Jul 13 04:17:39.183172 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:17:39.183155    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967\": container with ID starting with adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967 not found: ID does not exist" containerID="adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"
Jul 13 04:17:39.183244 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.183179    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967"} err="failed to get container status \"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967\": rpc error: code = NotFound desc = could not find container \"adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967\": container with ID starting with adf25f3f5c296799e5dffabcfb28701709d775e8a6f46c4f5891ae97d622b967 not found: ID does not exist"
Jul 13 04:17:39.183244 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.183196    2582 scope.go:117] "RemoveContainer" containerID="241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"
Jul 13 04:17:39.183463 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:17:39.183439    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61\": container with ID starting with 241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61 not found: ID does not exist" containerID="241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"
Jul 13 04:17:39.183511 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.183474    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61"} err="failed to get container status \"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61\": rpc error: code = NotFound desc = could not find container \"241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61\": container with ID starting with 241a957ca00ac2364f3ed6983b35bd8075c3c532454c33be7c20c6d140669a61 not found: ID does not exist"
Jul 13 04:17:39.246696 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.246894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246706    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.246894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.246894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.246894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246853    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.246894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbrp8\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.247228 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246912    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.247228 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246937    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.247228 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.246958    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket\") pod \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\" (UID: \"1f816ec9-9c7a-4d79-b22a-dbd9bf880d57\") "
Jul 13 04:17:39.247383 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:39.247451 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247363    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:17:39.247506 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247438    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:39.247611 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247584    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:39.247746 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247704    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:39.247902 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247880    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.247991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247904    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.247991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247918    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.247991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247931    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.247991 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.247943    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.249538 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.249518    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:17:39.249608 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.249535    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:17:39.249608 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.249547    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8" (OuterVolumeSpecName: "kube-api-access-jbrp8") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "kube-api-access-jbrp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:17:39.249608 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.249535    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" (UID: "1f816ec9-9c7a-4d79-b22a-dbd9bf880d57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:39.348382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.348347    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.348382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.348376    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.348382 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.348385    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.348611 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.348394    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbrp8\" (UniqueName: \"kubernetes.io/projected/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57-kube-api-access-jbrp8\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:39.487358 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.487324    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:17:39.491092 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.491064    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-694c02-openshift-default-69cbcc4fc9-5wz74"]
Jul 13 04:17:39.766437 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:39.766354    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" path="/var/lib/kubelet/pods/1f816ec9-9c7a-4d79-b22a-dbd9bf880d57/volumes"
Jul 13 04:17:40.286524 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:40.286493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:40.345061 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:40.345016    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:40.523871 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:40.523839    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:17:40.524104 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:40.524078    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy" containerID="cri-o://9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c" gracePeriod=30
Jul 13 04:17:40.546949 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:40.546886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:41.318792 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:41.318758    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55dd78bb6f-lnr5z_97b5e447-c450-4928-b518-692f8723f059/authorino/0.log"
Jul 13 04:17:45.758234 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.758202    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xjr82_0c7dc443-6fd7-4f5c-b4a4-991c007d91a5/manager/0.log"
Jul 13 04:17:45.775190 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.775168    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:17:45.868464 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.868431    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mjcvq_6f78cd9e-3d63-48b3-9ab7-7c20fd723943/manager/0.log"
Jul 13 04:17:45.903829 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903807    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5hqn\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.903927 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903844    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.903927 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903876    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.903927 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903921    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904101 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904101 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904101 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.903988    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904101 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904027    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904295 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904101    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert\") pod \"008d6d29-1500-4fd8-87e6-78ba3ca34501\" (UID: \"008d6d29-1500-4fd8-87e6-78ba3ca34501\") "
Jul 13 04:17:45.904295 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:45.904403 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904289    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:45.904460 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904382    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:45.904460 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904424    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-certs\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:45.904567 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904461    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-credential-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:45.904567 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904502    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 04:17:45.904988 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.904965    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data" (OuterVolumeSpecName: "istio-data") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:45.906128 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.906098    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn" (OuterVolumeSpecName: "kube-api-access-v5hqn") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "kube-api-access-v5hqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:17:45.906227 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.906162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token" (OuterVolumeSpecName: "istio-token") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 04:17:45.906490 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.906468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 04:17:45.906590 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:45.906568    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "008d6d29-1500-4fd8-87e6-78ba3ca34501" (UID: "008d6d29-1500-4fd8-87e6-78ba3ca34501"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 13 04:17:46.005482 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005450    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-workload-socket\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005482 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005478    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-envoy\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005482 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005490    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-data\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005501    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-token\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005512    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/008d6d29-1500-4fd8-87e6-78ba3ca34501-istio-podinfo\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005523    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/008d6d29-1500-4fd8-87e6-78ba3ca34501-istiod-ca-cert\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.005719 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.005534    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5hqn\" (UniqueName: \"kubernetes.io/projected/008d6d29-1500-4fd8-87e6-78ba3ca34501-kube-api-access-v5hqn\") on node \"ip-10-0-141-187.ec2.internal\" DevicePath \"\""
Jul 13 04:17:46.109910 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.109876    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gw9jk_400064e0-1118-4939-9be9-da4d97f3912c/server/0.log"
Jul 13 04:17:46.204900 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.204806    2582 generic.go:356] "Generic (PLEG): container finished" podID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerID="9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c" exitCode=0
Jul 13 04:17:46.204900 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.204884    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"
Jul 13 04:17:46.205073 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.204889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerDied","Data":"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"}
Jul 13 04:17:46.205073 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.204975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm" event={"ID":"008d6d29-1500-4fd8-87e6-78ba3ca34501","Type":"ContainerDied","Data":"35c91a01b13cf570b7b16881e840b7baf9812479698fc5b424985e5efa4a08ae"}
Jul 13 04:17:46.205073 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.205004    2582 scope.go:117] "RemoveContainer" containerID="9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"
Jul 13 04:17:46.214540 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.214524    2582 scope.go:117] "RemoveContainer" containerID="15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"
Jul 13 04:17:46.222822 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.222803    2582 scope.go:117] "RemoveContainer" containerID="9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"
Jul 13 04:17:46.223082 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:17:46.223061    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c\": container with ID starting with 9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c not found: ID does not exist" containerID="9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"
Jul 13 04:17:46.223190 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.223152    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c"} err="failed to get container status \"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c\": rpc error: code = NotFound desc = could not find container \"9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c\": container with ID starting with 9d36125969827ce2e05225703477eb34c653ea9b96b663e8878f3da39c78fc9c not found: ID does not exist"
Jul 13 04:17:46.223245 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.223194    2582 scope.go:117] "RemoveContainer" containerID="15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"
Jul 13 04:17:46.223422 ip-10-0-141-187 kubenswrapper[2582]: E0713 04:17:46.223404    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5\": container with ID starting with 15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5 not found: ID does not exist" containerID="15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"
Jul 13 04:17:46.223486 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.223431    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5"} err="failed to get container status \"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5\": rpc error: code = NotFound desc = could not find container \"15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5\": container with ID starting with 15b29a56064b24aabc5244bd67ebbe323e2dc0a174ab4bda9d9e3b012a77cfb5 not found: ID does not exist"
Jul 13 04:17:46.225880 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.225860    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gnllr_508085c7-3f61-4aaa-9960-63ff9bbc9f25/manager/0.log"
Jul 13 04:17:46.227461 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.227443    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:17:46.229218 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.229196    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-830ad7-openshift-default-776bb86795-ntnxm"]
Jul 13 04:17:46.337879 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.337852    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-c8wfc_d016dc42-399e-48e6-ad4e-1220323f8da5/copy-manifests/0.log"
Jul 13 04:17:46.350031 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:46.349988    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-c8wfc_d016dc42-399e-48e6-ad4e-1220323f8da5/manager/0.log"
Jul 13 04:17:47.760460 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:47.760428    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" path="/var/lib/kubelet/pods/008d6d29-1500-4fd8-87e6-78ba3ca34501/volumes"
Jul 13 04:17:47.837030 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:47.837000    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55dd78bb6f-lnr5z_97b5e447-c450-4928-b518-692f8723f059/authorino/0.log"
Jul 13 04:17:47.957186 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:47.957150    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mwq7p_a6c1d06f-3732-40c4-b9a1-d7c783566c81/manager/0.log"
Jul 13 04:17:48.305256 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:48.305210    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8dkwn_aa1170bd-50f6-4d36-97e0-a741a48cbe83/registry-server/0.log"
Jul 13 04:17:48.656624 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:48.656545    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xnh5s_afaa03f7-fd7b-47d0-a6ae-cf12c6831524/manager/0.log"
Jul 13 04:17:48.993465 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:48.993382    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45s49g_7fc71d85-fc40-48f9-997d-18cfe41b562b/istio-proxy/0.log"
Jul 13 04:17:49.335843 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:49.335811    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bfd7dd56-hzthb_eae1bc61-4640-44db-a1ba-0427a4671b5a/kube-auth-proxy/0.log"
Jul 13 04:17:49.449692 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:49.449660    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/1.log"
Jul 13 04:17:50.154179 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:50.154151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-mzd9l_a7cd2620-b7f3-4383-baec-02f886d9ab28/main/0.log"
Jul 13 04:17:50.475761 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:50.475663    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd7fl6_0335cf1a-5a63-4554-a0e1-ec289c238db3/main/0.log"
Jul 13 04:17:55.092216 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:55.092185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:55.193583 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:55.193540    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:17:58.118197 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:58.118171    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fks58_1889e832-d11e-4813-85ce-c9472ecfa0a0/global-pull-secret-syncer/0.log"
Jul 13 04:17:58.206664 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:58.206632    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log"
Jul 13 04:17:58.345547 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:17:58.345521    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-187.ec2.internal_a756bfda3d81489a4206188fd0c02f7c/haproxy/0.log"
Jul 13 04:18:03.641155 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:03.641119    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-55dd78bb6f-lnr5z_97b5e447-c450-4928-b518-692f8723f059/authorino/0.log"
Jul 13 04:18:03.669107 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:03.669071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mwq7p_a6c1d06f-3732-40c4-b9a1-d7c783566c81/manager/0.log"
Jul 13 04:18:03.826357 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:03.826325    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8dkwn_aa1170bd-50f6-4d36-97e0-a741a48cbe83/registry-server/0.log"
Jul 13 04:18:04.022764 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:04.022662    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xnh5s_afaa03f7-fd7b-47d0-a6ae-cf12c6831524/manager/0.log"
Jul 13 04:18:06.235007 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:06.234979    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dpfp_60bc5b45-325a-40d1-a0c5-079a820cca51/node-exporter/0.log"
Jul 13 04:18:06.256981 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:06.256956    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dpfp_60bc5b45-325a-40d1-a0c5-079a820cca51/kube-rbac-proxy/0.log"
Jul 13 04:18:06.281276 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:06.281252    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7dpfp_60bc5b45-325a-40d1-a0c5-079a820cca51/init-textfile/0.log"
Jul 13 04:18:06.570156 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:06.570125    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5jcsz_c36e1048-4bb5-4d72-b72d-caf0b44de93e/konnectivity-agent/0.log" limit=1024
Jul 13 04:18:08.557611 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557582    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"]
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557943    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy"
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557955    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy"
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557970    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557977    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557982    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.558021 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.557988    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.558214 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.558051    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="02448204-140c-48c0-a948-e028793441f3" containerName="istio-proxy"
Jul 13 04:18:08.558214 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.558058    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f816ec9-9c7a-4d79-b22a-dbd9bf880d57" containerName="istio-proxy"
Jul 13 04:18:08.558214 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.558064    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.558214 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.558071    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="008d6d29-1500-4fd8-87e6-78ba3ca34501" containerName="istio-proxy"
Jul 13 04:18:08.560083 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.560064    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.562295 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.562272    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvgg\"/\"kube-root-ca.crt\""
Jul 13 04:18:08.562401 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.562362    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpvgg\"/\"openshift-service-ca.crt\""
Jul 13 04:18:08.563259 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.563243    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpvgg\"/\"default-dockercfg-k7b9k\""
Jul 13 04:18:08.569174 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.569155    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"]
Jul 13 04:18:08.706876 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.706837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plrsb\" (UniqueName: \"kubernetes.io/projected/46ab077d-d4ab-4331-a998-70a5cfd86ee1-kube-api-access-plrsb\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.707057 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.706921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-lib-modules\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.707057 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.706948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-proc\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.707057 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.706966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-podres\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.707057 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.706999    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-sys\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.807759 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-lib-modules\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.807759 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807685    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-proc\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.807759 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807705    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-podres\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-proc\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-podres\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-lib-modules\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-sys\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46ab077d-d4ab-4331-a998-70a5cfd86ee1-sys\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.808076 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.807949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plrsb\" (UniqueName: \"kubernetes.io/projected/46ab077d-d4ab-4331-a998-70a5cfd86ee1-kube-api-access-plrsb\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.814944 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.814917    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plrsb\" (UniqueName: \"kubernetes.io/projected/46ab077d-d4ab-4331-a998-70a5cfd86ee1-kube-api-access-plrsb\") pod \"perf-node-gather-daemonset-lm6fl\" (UID: \"46ab077d-d4ab-4331-a998-70a5cfd86ee1\") " pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:08.870593 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:08.870562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:09.005686 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.005658    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"]
Jul 13 04:18:09.008052 ip-10-0-141-187 kubenswrapper[2582]: W0713 04:18:09.008024    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod46ab077d_d4ab_4331_a998_70a5cfd86ee1.slice/crio-68abe5d871dbdc8f9dd7936d087f89df80013c7dd35b0697aad486a23aec6905 WatchSource:0}: Error finding container 68abe5d871dbdc8f9dd7936d087f89df80013c7dd35b0697aad486a23aec6905: Status 404 returned error can't find the container with id 68abe5d871dbdc8f9dd7936d087f89df80013c7dd35b0697aad486a23aec6905
Jul 13 04:18:09.322252 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.322218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl" event={"ID":"46ab077d-d4ab-4331-a998-70a5cfd86ee1","Type":"ContainerStarted","Data":"7f00843e8dd16ec502b06f746a1185007a8b3f18d97b04574959fb1902b5cf1d"}
Jul 13 04:18:09.322439 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.322269    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl" event={"ID":"46ab077d-d4ab-4331-a998-70a5cfd86ee1","Type":"ContainerStarted","Data":"68abe5d871dbdc8f9dd7936d087f89df80013c7dd35b0697aad486a23aec6905"}
Jul 13 04:18:09.322439 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.322354    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:09.338158 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.338104    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl" podStartSLOduration=1.338091234 podStartE2EDuration="1.338091234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 04:18:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 04:18:09.335997236 +0000 UTC m=+2208.111711516" watchObservedRunningTime="2026-07-13 04:18:09.338091234 +0000 UTC m=+2208.113805514"
Jul 13 04:18:09.365314 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.365294    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b8968bfb5-wspnd_92a2a977-216a-487a-b8a2-b13565678a29/console/0.log"
Jul 13 04:18:09.395075 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:09.395008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-kbx4w_e9f03bcb-8d30-4256-b41f-25de126a9f30/download-server/0.log"
Jul 13 04:18:11.150797 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:11.150767    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whw4z_c148312f-d974-4424-a520-e6af34346644/dns/0.log"
Jul 13 04:18:11.169495 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:11.169469    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-whw4z_c148312f-d974-4424-a520-e6af34346644/kube-rbac-proxy/0.log"
Jul 13 04:18:11.192317 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:11.192293    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-b8f79_90b58b40-a7cd-44a2-8671-7e82728cf5f5/dns-node-resolver/0.log"
Jul 13 04:18:11.739290 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:11.739254    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-55dcb6bb67-p52v5_606b922e-ed09-456a-87a2-891454e4d0a7/registry/0.log"
Jul 13 04:18:11.803509 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:11.803481    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xjbxn_59dde4e2-5c97-4c8a-b822-12010aebafa2/node-ca/0.log"
Jul 13 04:18:12.729024 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:12.728995    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45s49g_7fc71d85-fc40-48f9-997d-18cfe41b562b/istio-proxy/0.log"
Jul 13 04:18:12.877001 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:12.876973    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bfd7dd56-hzthb_eae1bc61-4640-44db-a1ba-0427a4671b5a/kube-auth-proxy/0.log"
Jul 13 04:18:12.903927 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:12.903887    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/0.log"
Jul 13 04:18:12.930900 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:12.930875    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/1.log"
Jul 13 04:18:13.718715 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:13.718685    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kdf55_f56d0347-7f5b-4fc5-b1d8-9bb38580f906/serve-healthcheck-canary/0.log"
Jul 13 04:18:14.281658 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:14.281627    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j577x_b1ecd1bc-f07d-417c-87ef-3a58e8992138/kube-rbac-proxy/0.log"
Jul 13 04:18:14.301067 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:14.301041    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j577x_b1ecd1bc-f07d-417c-87ef-3a58e8992138/exporter/0.log"
Jul 13 04:18:14.321499 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:14.321473    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-j577x_b1ecd1bc-f07d-417c-87ef-3a58e8992138/extractor/0.log"
Jul 13 04:18:15.336262 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:15.336238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpvgg/perf-node-gather-daemonset-lm6fl"
Jul 13 04:18:16.718043 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:16.718014    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xjr82_0c7dc443-6fd7-4f5c-b4a4-991c007d91a5/manager/0.log"
Jul 13 04:18:16.820572 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:16.820546    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-mjcvq_6f78cd9e-3d63-48b3-9ab7-7c20fd723943/manager/0.log"
Jul 13 04:18:16.924020 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:16.923947    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gw9jk_400064e0-1118-4939-9be9-da4d97f3912c/server/0.log"
Jul 13 04:18:16.994129 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:16.994105    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-gnllr_508085c7-3f61-4aaa-9960-63ff9bbc9f25/manager/0.log"
Jul 13 04:18:17.055801 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:17.055773    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-c8wfc_d016dc42-399e-48e6-ad4e-1220323f8da5/manager/0.log"
Jul 13 04:18:17.072422 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:17.072401    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6d6757d97b-c8wfc_d016dc42-399e-48e6-ad4e-1220323f8da5/copy-manifests/0.log"
Jul 13 04:18:18.494875 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:18.494847    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-ktc6w_b14dc812-9f52-4cb1-b9b6-64a223af9b79/openshift-lws-operator/0.log"
Jul 13 04:18:19.938867 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:19.938841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45s49g_7fc71d85-fc40-48f9-997d-18cfe41b562b/istio-proxy/0.log"
Jul 13 04:18:20.064341 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:20.064308    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bfd7dd56-hzthb_eae1bc61-4640-44db-a1ba-0427a4671b5a/kube-auth-proxy/0.log"
Jul 13 04:18:20.086676 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:20.086646    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/0.log"
Jul 13 04:18:20.113061 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:20.113030    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/1.log"
Jul 13 04:18:21.494913 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:21.494881    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf45s49g_7fc71d85-fc40-48f9-997d-18cfe41b562b/istio-proxy/0.log"
Jul 13 04:18:21.622485 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:21.622452    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bfd7dd56-hzthb_eae1bc61-4640-44db-a1ba-0427a4671b5a/kube-auth-proxy/0.log"
Jul 13 04:18:21.645766 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:21.645716    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/0.log"
Jul 13 04:18:21.675664 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:21.675632    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-7wqp5_4ea189d5-50d2-4844-adc7-c6603860bd8f/istio-proxy/1.log"
Jul 13 04:18:25.531038 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.531008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/kube-multus-additional-cni-plugins/0.log"
Jul 13 04:18:25.558273 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.558246    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/egress-router-binary-copy/0.log"
Jul 13 04:18:25.582894 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.582862    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/cni-plugins/0.log"
Jul 13 04:18:25.603806 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.603779    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/bond-cni-plugin/0.log"
Jul 13 04:18:25.623445 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.623423    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/routeoverride-cni/0.log"
Jul 13 04:18:25.643352 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.643330    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/whereabouts-cni-bincopy/0.log"
Jul 13 04:18:25.663012 ip-10-0-141-187 kubenswrapper[2582]: I0713 04:18:25.662994    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sllkc_6b6e5938-52d8-4c7f-966c-0c1889b2fd7e/whereabouts-cni/0.log"